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APPENDIX A: EXAMPLE OF CONTEXT FOR ASSESSING STATE- 
LEVEL STAKES SHEET— CONNECTICUT 



Background 

Connecticut has two criterion-referenced assessments called the Connecticut 
Mastery Test (CMT) given to students in grades K-8 and the Connecticut Academic 
Performance Test (CAPT) given to students in grade 10. 

Connecticut Mastery Test 

The Connecticut Mastery Test (CMT) is a criterion-referenced test administered 
to grades 4, 6, and 8 dating back to 1985. Students in these grades are tested annually in 
the fall of the school year. A second generation of CMT was introduced in 1993 and a 
third in 2000. Mastery and state standards have been set for each content area of the test 
at each grade level and reports of individual student achievement relative to these 
standards in the areas of math, reading, and writing are provided to parents of tested 
students. 

The legislation prohibits the use of test scores as the sole criterion for promotion 
and graduation. The purposes of the CMT are: to set high expectations for students, to 
test a range of academic skills, to disseminate test information about students, schools 
and districts, to identify students in need of intervention, to assess equitable educational 
opportunities, and to continually monitor student progress in grades 4, 6, and 8 over time. 
A fourth generation of CMT is going to be administered to students in grades 3-8 
beginning in the spring of 2006. 
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Connecticut Academic Performance Test 



The Connecticut Academic Performance Test (CAPT) is the logical extension of 
the CMT for high school students. This test was first administered to students in grade 
10 in the spring of 1994. A second generation was introduced in May 2001 after two 
years of development. This is a criterion-referenced examination designed to measure 
student progress toward meeting state standards in each subject area. The state 
legislature mandated that student graduation NOT be solely contingent on test 
performance. However, student performance on these tests does become a part of their 
permanent school record and the official high school transcript. 

The purpose of the CAPT is to: set high expectations and standards for student 
achievement across a broad range of skills and knowledge, to emphasize the application 
and integration of skills and knowledge in realistic contexts, to promote better instruction 
and curriculum by providing useful test achievement data to parents, schools, and 
districts, and to provide an expanded measure of accountability for all levels of 
Connecticut’s education system up and including high school. 1 

Students are tested across four performance areas including, math, reading, 
writing, and science. The test was designed specifically to go beyond traditional 
classroom assessments and to probe for what students know and how well they apply 
what they know. 

Brief Overview of Rewards and Sanctions 

The federal No Child Left Behind (NCLB) Act of 2001 requires a statewide 
school accountability system. As part of this system, school districts receiving federal 
dollars based on the percentage of district students in poverty (referred to as Title I funds) 
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must prepare and disseminate annual accountability reports which in Connecticut, present 



the performance of students in mathematics and reading on the Connecticut Mastery Test 
(CMT) and the Connecticut Academic Performance Test (CAPT). Students can score at 
five levels on the tests: Advanced, Goal, Proficient, Basic or Below Basic. The 
accountability system accompanying the federal NCLB Act establishes standards based 
on the percentage of students scoring at the Proficient level or higher. 

Schools and Districts 

The CAPT results are the primary basis for assessing annual progress of high 
schools and districts specified under NCLB. The state is required to determine annually 
if every district and school is making adequate yearly progress (AYP) toward reaching 
the goal, by 2014, of having 100 percent of its student population scoring at or above the 
Proficient level in mathematics and reading on the CMT and CAPT. For a school or 
district to have made AYP, the following criteria must have been met by all students in 
the district and each subgroup (major racial and ethnic groups, students in poverty, 
students with disabilities and English language learners): (1) 95 percent participation on 
both the mathematics and reading on the CMT and CAPT; (2) achievement of the AYP 
target percentage at or above Proficient in mathematics and reading on the CMT and 
CAPT; and (3) achievement of the AYP target for an additional academic indicator, 70 
percent at or above Basic on the writing subtest of the CMT or improvement from the 
previous year for elementary and middle schools, and 70 percent graduation rate or 
improvement from the previous year for high schools. If a district does not make AYP 
for two consecutive years, it will be identified as "in need of improvement." NCLB also 



Page 115 of 336 

This document is available on the Education Policy Studies Laboratory website at: 

http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0509-105-EPRU.pdf 





requires both CMT and CAPT data to be reported out by three different achievement 



levels: Basic, Proficient and Advanced. 

In 1983, the State Board of Education requested $2 mi llion for a new state grant 
for school districts with the greatest academic need. The new grant became known as the 
Priority School District Program (PSD). Thus, dating over the past two decades, 
Connecticut has instituted a system for identifying low performing districts and schools 
and for providing them with academic assistance. 

No Child Left Behind Act Implementation 

The federal No Child Left Behind (NCLB) Act's many detailed mandates for 
states and local school districts, and the cost for implementing them, are likely to remain 
an ongoing issue for the Education Committee and the General Assembly in 2004. Some 
Connecticut school districts have chosen to reject federal education funding for their low- 
income students to avoid complying with NCLB mandates. Meanwhile, the state has 
already identified 149 schools and 99 school districts that have so far failed to make the 
annual student achievement improvements that NCLB requires. Schools and school 
districts that repeatedly fail to achieve the mandated level of annual improvement are 
subject to sanctions. 

To measure improvement, the federal law requires annual testing for students in 
grades three through eight starting in 2005. These requirements may prompt debate 
about standardized tests, including (1) whether to use student test scores to evaluate 
teachers; (2) whether to require students to pass a test to graduate from high school; (3) 
test content, timing, and administration; and (4) whether tests are a valid school 
accountability tool. 
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Students 



The CAPT is not used as the sole criterion for graduation, but does have some 
stakes associated with it at the student level. Although there is no passing score on the 
CAPT per se, the State Board of Education has established goal standards for grade 10 
students that represent “high, yet reasonable, expectations for students at the end of grade 
10.” Stakes for students are that test results become part of their permanent record. Also, 
students who meet these “goal standards” can receive a “Certification of Mastery” 
indicating they met the goal standard. 
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APPENDIX B: EXAMPLE OF COMPLETED REWARDS AND 
SANCTIONS WORKSHEET— CONNECTICUT 



CONNECTICUT 


Achievement Test(s) Used for Accountability Decisions 


Connecticut Mastery Test (CMT), Connecticut Academic 
Performance Test (CAPT) 




Notes on Assessment System 


CMT and CAPT are both criterion referenced examinations. The 
CMT dates back to 1985 and the CAPT to 1994. 




Test Content/Timing 


Students in grades 4, 6, and 8 take the CMT in math reading, and 
writing. As of spring 2006, students in grades 3, 5, and 7 will also 
take the exam. Students in grade 10 take the CAPT and they can 
retake it in 1 1th and 12th grades if necessary. The CAPT covers 
math, reading, writing, and science. 


SANCTIONS 




1. Does state have authority to put School districts on 
probation? 


No 




2. Can state remove a district's accreditation? 


No 


DISTRICTS 
(6 Possible) 


3. Can the state withhold funding from the district? 


Only under Title I schools. State has a system of providing funds 
to schools that are in academic distress. 


4. Can the state reorganize the district? 


Yes, only Title I Districts based on NCLB mandates. But, it hasn't 
happened. 




5. Can the state take over the district? 


Yes, only Title I Districts based on NCLB mandates. But, it hasn't 
happened. 




6. Does the state have the authority to replace 
superintendents ? 


Yes, only Title I Districts based on NCLB mandates. But, it hasn't 
happened. 




7. Can schools be placed on probation? 


No 




8. Can the state remove a school's accreditation? 


No 




9. Can the state withhold funding from the schools? 


Only under Title I schools. State has a system of providing funds 
to schools that are in academic distress. 




10. Can the state reconstitute a school? 


Yes, only Title I Schools are subject to reconstitution based on 
NCLB mandates. But, it hasn't happened yet. 


SCHOOLS 






(8 Possible) 


1 1 . Can the state close a school? 


Yes, only Title I Schools are subject to reconstitution based on 
NCLB mandates. But, it hasn't happened yet. 




12. Can the state take over the school? 


Yes, only Title I Schools are subject to reconstitution based on 
NCLB mandates. But, it hasn't happened yet. 




13. Does state have authority to replace teachers? 


No 




14. Does state have authority to replace principals? 


No 
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15. K-8: Grade to grade promotion contingent on 
promotion exam? 


No, not solely on the test. Districts have latitude in the type of 
criterion they establish for promotional decisions. However, 
recently, the state department mandated that students' 
performance on the CMT be at least one indicator. 




K-8: If yes, for students in what grades and timing of 
implementation. 


N/A. In some districts, students are required to attend summer 
school or Saturday classes if they do not meet minimum 
proficiency on the exam in order to be promoted. 




SANCTIONS (CONT'D) 


STUDENTS 
(2 Possible) 


16. HIGH SCHOOL: Do students have to pass an 
exam in order to receive a diploma? 


No. However, all students MUST TAKE the CAPT to get a 
diploma. Only if students do not achieve minimum competency 
on the exam is it possible to withhold a diploma. But, other 
factors are included in diploma-granting decisions. 




HIGH SCHOOL: Are there alternate routes to 
receiving a diploma? 


N/A 




HIGH SCHOOL: Are students required to attend 
remediation program if they fail the graduation exam? 
(who pays for it?) 


N/A 




Students for whom English is a Second Language 


State law allows LEP students, and LEP students only, to be 
exempt from the CMT as deemed appropriate. However, if they 
do participate, accommodations are allowed. In contrast, ALL 
students must take grade-level CAPT— however again, 
accommodations are allowed. 




Students with Disabilities 


There is an alternative assessment available. But, as per NCLB, at 
least 80% of students in special education must participate in 
standard grade-level version of the CMT or CAPT (with 
accommodations). This means that 20% of students can take one 
of two alternative assessment options available in the state. 




Ratio of number of Sanctions implemented versus 
number possible 


8 out of 16 Sanctions possible 


REWARDS 




1 . Are districts rewarded for student performance? 


Yes 


DISTRICTS 
(2 Possible- 
Monetary/ 


What type of awards are given? (public recognition, 
certificates, monetary... etc.) 


Public recognition 


non-monetary) 


On what are rewards based (Absolute performance or 
Improvement?) 


Both 


SCHOOLS 
(2 Possible- 
Monetary/ 
Non-monetary) 


2. Are schools rewarded for student performance? 


Yes 


What type of awards are given? (public recognition, 
certificates, monetary... etc.) 


Public recognition 
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On what are rewards based (Absolute performance or 
Improvement?) 


Both 


Who receives the reward? (teachers, principals, 
schools, all, none)? 


N/A 


STUDENTS 
(2 possible- 
Monetary/ 
Non-Monetary) 


3. Monetary awards or scholarships for college tuition 
are given to high performing students 


No 


4. Public recognition of high performing students 


No. CAPT performance is part of student's personal record and is 
included on his/her transcript. 




Ratio of number of Rewards given versus number 
possible 


2 out of 4 Rewards possible 
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APPENDIX C: DIRECTIONS GIVEN TO JUDGES 

The purpose of this study is for you, the “judge,” to determine the magnitude of pressure 
exerted on students, teachers, and/or administrators through state-level high-stakes testing 
policies. We believe that when consequences are tied to assessment, they increase the pressure 
on schools, teachers and students to perform well on standardized tests. The pressure may be 
minor, causing little worry for students or teachers. Or, the pressure could be of such a 
magnitude that it causes anger or resistance to occur. Our goal is to rank states according to the 
extent to which students and school personnel feel “pressure” to do well on standardized 
achievement tests. Your job is to help make these comparisons. 

Comparisons are based on a portfolio of documents outlining a single state’s 
accountability system. You will get two portfolios to rate. Each portfolio contains the 
following: 

1. Background information on the assessment and accountability policies in the state. 

2. A rewards/sanctions Worksheet that outlines the most current accountability laws in 
the state. 

3. A selection of news stories about testing and accountability in that state. 

4. An appendix of legislative and web documents outlining various laws and regulations 
in the state related to accountability. 

Based on these documents, judges make a single judgment: Deciding which of the two states 
exerts more pressure on students, teachers, administrators, and parents. 

Directions for reviewing News Stories : A significant part of each state’s portfolio 
includes a selection of news stories that are specific to that state. Readers should use these 
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stories to supplement the other documents in the portfolio. Readers should read the 
selection of stories with an eye toward the following: 

1. To get a sense of time — how long has the issue been in the press? 

a. When did stories of accountability first appear? 

b. What was the general reaction to the implementation of the accountability 
legislation? 

c. When were students first being tested and/or held to some sort of standard for 
making decisions about them and/or their schools and teachers? 

2. To gauge a “level of press” loosely defined by the following: 

a. Time: How long has the state been debating about accountability tied to student 
performance? 

b. Implementation'. Evidence of state-imposed consequences to schools, teachers, 
and/or students. 

i. Are there many examples? 

ii. How “severe” are the examples (e.g., who do they effect, how significant 
are the effects to an individual’ s life?) 

c. Location of Blame\ Is there a pattern of blame in the press? 

i. For example, are stories more often focused on the flaws of the test? Or, 
on the flaws of students? Or schools and/or teachers? 

ii. Who initiated consequence-based legislation? (e.g., was it driven by 
NCLB? Had it been evident in the state for a while? Were parents calling 
on change or were policymakers? Or, did it seem like a shared concern?) 
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iii. Who is affected by test results (e.g., who does the test hurt? Who does it 



help? How severe is this consequence?) 

Using the worksheet on the following page, outline any notes, thoughts you have as you read 
through documents. Then, when you are done reading both states’ portfolios... use the scale at 
the end to place/rank each state according to “level of press.” 



A NOTE about news stories selected for inclusion: The selection of news stories included in 
the portfolio give a “ snapshot ” of accountability over time. Thus , it is important to note that 
stories on legislative decisions from the 90s may have been reversed or amended over time. 
The SANCTIONS/REWARDS WORKSHEET represents what is currently known about the 
laws in each state. 
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APPENDIX D: DATA COLLECTION SHEET 



Please provide some general information about yourself: 

1. Gender (circle one): Female Male 

2. Age. 

3. Are you in school currently? (Circle one) Yes No 

If yes: What level of schooling are you in? (Circle one): 

Under graduate (BA, BS) Graduate (MA, EdD, PhD) 

If Undergraduate — 

Are you a: Freshman Sophomore Junior Senior Other 

How many units have you completed? 

What is your major area of study?. 

If Graduate — 

How many units (or years if more relevant) have you completed so far?. 

What is your major area of study?. 

4. Have you ever taught? (Circle one): Yes No 

If Yes: Briefly describe how long you have taught, in what grades, and what state 
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STATE 1 



STATE 2 



Summary of Laws (Rewards/Punish) Summary of Laws (Rewards/Punish) 



Summary of News (Tone/Focus/Blame) Summary of News (Tone/Focus/Blame) 



Guiding Questions for both states: 



What would it be like to be a student in this state? 



What would it be like to be an administrator in this state? 



What would it be like to be a teacher in this state? 
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RANK (circle the number you think best represents the overall level of threat in each state) 

RULE: You cannot assign the same number to both states. 



STATE 1 



LOWEST level of threat 
(hardly any test-related pressure) 

1 2 3 4 5 



HIGHEST level of threat 
(A lot of test-related pressure) 
6 7 



NOTES: 



STATE 2_ 

LOWEST level of threat 
(hardly any test-related pressure) 

1 2 3 4 5 



HIGHEST level of threat 
(A lot of test-related pressure) 
6 7 



NOTES: 
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APPENDIX E: CORRELATIONS AND SCATTER PLOTS— 
THREAT CHANGE AND NAEP GAIN 



MATH GRADE 4 



Table 1: Correlations of Threat Change and NAEP Gain: All Students 



PRI 



1992 

NAEP 

Average 



1996 

NAEP 

Average 



2000 

NAEP 

Average* 



2000 

NAEP 

Average 



2003 

NAEP 

Average 



1992-2003 

NAEP 

Gain 



Threat 

Rating 

Change 

1992-2003 



PRI 1.000 



1992 NAEP Average 


-0.385 


1.000 




1996 NAEP Average 


-0.175 


0.893 


1.000 







2000 NAEP Average* -0.055 0.808 0.920 1.000 




2003 NAEP Average 


-0.078 


0.771 


0.808 


0.913 


0.922 


1.000 






1992-2003 NAEP Gain 


0.499 


-0.554 


-0.338 


-0.068 


-0.079 


0.103 


1.000 




Threat Rating Change 
1992-2003 


0.436 


-0.132 


0.048 


0.112 


0.062 


0.125 


0.370 


1.000 



* Denotes no accommodations that year. 

Partial r =.244 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Change 1 
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MATH GRADE 4, continued 



Table 2: Correlations of Threat Change and NAEP Gain: African American Students 







1992* 


1996* 


2000* 


2000 NAEP 
African 
American 


2003 NAEP 
African 
American 


NAEP Gain 


Threat 




PRI 


NAEP 

African 

American 


NAEP 

African 

American 


NAEP 

African 

American 


1992-2003 

African 

American 


Rating 

Change 

1992-2003 


PRI 


1.000 
















1992* NAEP 
African American 


0.364 


1.000 














1996* NAEP 
African American 


0.381 


0.999 


1.000 












2000* NAEP 
African American 


0.316 


0.830 


0.839 


1.000 










2000 NAEP 
African American 


0.314 


0.830 


0.839 


1.000 


1.000 








2003 NAEP 
African American 


0.389 


0.997 


0.999 


0.851 


0.852 


1.000 






NAEP Gain 1992- 
2003 African 


0.491 


0.773 


0.798 


0.832 


0.836 


0.821 


1.000 




American 


















Threat Rating 
Change 1992-2003 


0.436 


0.217 


0.219 


0.232 


0.224 


0.219 


0.194 


1.000 



* Denotes no accommodations. 

Partial r= .161 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Change 1992-2003 



MATH GRADE 4, continued 



Figure 2: Scatter Plot of Threat Change and NAEP Gain: African American Students 




Math Fourth Grade NAEP Scale Score Gain 1992-2003: 
African American Students 
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MATH GRADE 4, continued 



Table 3: Correlations of Threat Change and NAEP Gain: Hispanic Students 





PRI 


1992* 

NAEP 

Hispanic 


1996* 

NAEP 

Hispanic 


2000* 

NAEP 

Hispanic 


2000 NAEP 
Hispanic 


2003 NAEP 
Hispanic 


NAEP Gain 
1992-2003 
Hispanic 


Threat Rating 
Change 1992- 
2003 


PRI 


1.000 


1 














1992* NAEP 
Hispanic 


-0.213 


1.000 














1996* NAEP 
Hispanic 


-0.029 


0.773 


1.000 












2000* NAEP 
Hispanic 


0.253 


-0.348 


-0.313 


1.000 










2000 NAEP Hispanic 


0.262 


-0.346 


-0.308 


0.998 


1.000 








2003 NAEP Hispanic 


- 0.111 


0.789 


0.774 


-0.211 


-0.206 


1.000 






NAEP Gain 1992- 
2003 Hispanic 


0.190 


-0.513 


-0.167 


0.267 


0.270 


0.123 


1.000 


' 


Threat Rating 
Change 1992-2003 


0.436 


-0.130 


0.071 


0.160 


0.162 


0.124 


0.383 


1.000 



* Denotes no accommodations. 

Partial r=370 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Change 1992-2003 



MATH GRADE 4, continued 



Figure 3: Scatter Plot of Threat Change and NAEP Gain: Hispanic Students 




Math Fourth Grade NAEP Scale Score Gain 1992-2003: 
Hispanic Students 
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MATH GRADE 4, continued 



Table 4: Correlations of Threat Change and NAEP Gain: White Students 





PRI 


1992* 

NAEP 

White 


1996* NAEP 
White 


2000* NAEP 
White 


2000 NAEP 
White 


2003 NAEP 
White 


NAEP Gain 
1992-2003 
White 


Threat Rating 
Change 1992- 
2003 


PRI 


1.000 
















1992* NAEP White 


-0.011 


1.000 














1996* NAEP White 


0.195 


0.754 


1.000 












2000* NAEP White 


0.262 


0.751 


0.845 


1.000 










2000 NAEP White 


0.261 


0.765 


0.848 


0.988 


1.000 








2003 NAEP White 


0.277 


0.674 


0.624 


0.864 


0.859 


1.000 






NAEP Gain 1992-2003 
White 


0.357 


-0.396 


-0.153 


0.148 


0.124 


0.412 


1.000 




Threat Rating Change 
1992-2003 


0.436 


-0.154 


-0.008 


0.026 


-0.003 


0.052 


0.254 


1.000 



* Denotes no accommodations. 

Partial r =.200 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Change 1992-2003 



MATH GRADE 4, continued 



Figure 4: Scatter Plot of Threat Change and NAEP Gain: White Students 




Math Fourth Grade NAEP Scale Score Gain 1992-2003: White 

Students 



Page 134 of 336 

This document is available on the Education Policy Studies Laboratory website at: http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0509-105- 

EPRU.pdf 






MATH GRADE 8 



Table 5: Correlations of Threat Change and NAEP Gain: All Students 





PRI 


1990* 

NAEP 


1992* 

NAEP 


1996* 

NAEP 


2000* 

NAEP 


2000 

NAEP 


2003 

NAEP 


Threat 

Rating 

Change 

1990-2003 


NAEP 
Gain 1990- 
2003 


PRI 


1.000 



















1990* NAEP -0.060 1.000 



1992* NAEP -0.415 -0.196 1.000 



1996* NAEP -0.376 -0.154 0.966 1.000 

2000* NAEP -0.219 -0.040 0.847 0.918 1.000 

2000 NAEP -0.247 -0.063 0.852 0.909 0.981 1.000 




2003 NAEP 


-0.186 


-0.178 


0.843 


0.860 


0.934 


0.926 


1.000 






Threat Rating 
Change 1990-2003 


0.524 


-0.075 


-0.370 


-0.352 


-0.177 


-0.237 


-0.131 


1.000 




NAEP Gain 1990- 
2003 


0.372 


0.362 


-0.304 


-0.199 


0.147 


0.107 


0.190 


0.283 


1.000 



* Denotes no accommodations, 
r = .268 without outlier of NC. 

Partial r = .280 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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MATH GRADE 8, continued 



Table 6: Correlations of Threat Change and NAEP Gain: African American Students 

1990* NAEP 1992* NAEP 1996* NAEP 2000* NAEP 2000 NAEP 
PRI African African African African African 

American American American American American 



PRI 


1.000 




1990* NAEP 






African 

American 


0.165 


1.000 



1992* NAEP 

African 0.293 0.562 1.000 

American 
1996* NAEP 

African 0.331 0.554 0.998 1.000 

American 




2000 NAEP 

African 0.307 0.563 0.998 0.997 1.000 1.000 

American 



2003 NAEP 

African 

American 


0.460 


0.540 


0.743 


0.740 


0.746 


0.742 


1.000 




Threat 

Rating 

Change 

1990-2003 


0.524 


0.076 


0.291 


0.306 


0.298 


0.300 


0.348 


1.000 


NAEP Gain 
1990 (1992) - 
2003 


0.494 


0.645 


0.688 


0.704 


0.706 


0.702 


0.680 


0.330 



*Denotes no accommodations. 

Partial r - .315 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 




2003 NAEP 
African 
American 



Threat 

Rating 

Change 

1990-2003 
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NAEP 
Gain 1990 
(1992) - 
2003 




1.000 








PRI Gain 1990-2003 



MATH GRADE 8, continued 



Figure 6: Scatter Plot of Threat Change and NAEP Gain: African American Students 
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Math Eighth Grade NAEP Scale Score Gain 1990-2003: 
African American Students 
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MATH GRADE 8, continued 



Table 7: Correlations of Threat Change and NAEP Gain: Hispanic Students 





PRI 


1990* 

NAEP 


1992* 

NAEP 


1996* 

NAEP 


2000* 

NAEP 


2000 

NAEP 


2003 

NAEP 


Threat 

Rating 

Change 

1990-2003 


NAEP Gain 
1990 (1992) - 
2003 
Hispanic 






Hispanic 


Hispanic 


Hispanic 


Hispanic 


Hispanic 


Hispanic 


PRI 


1.000 


















1990* NAEP Hispanic 


0.045 


1.000 
















1992* NAEP Hispanic 


0.227 


0.354 


1.000 


































1996* NAEP Hispanic 


0.517 


0.180 


0.715 


1.000 












2000* NAEP Hispanic 


0.544 


0.192 


0.710 


0.994 


1.000 










2000 NAEP Hispanic 


0.485 


-0.032 


-0.047 


0.638 


0.642 


1.000 








2003 NAEP Hispanic 


-0.118 


-0.157 


-0.198 


-0.117 


-0.103 


0.207 


1.000 
























Threat Rating Change 
1990-2003 


0.524 


0.021 


0.125 


0.228 


0.247 


0.157 


-0.171 


1.000 




NAEP Gain 1990 
(1992) - 2003 Hispanic 


0.082 


-0.038 


0.219 


0.122 


0.155 


-0.189 


0.139 


0.112 


1.000 



* Denotes no accommodations. 

Partial r = .077 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Gain 1990-2003 



MATH GRADE 8, continued 



Figure 7: Scatter Plot of Threat Change and NAEP Gain: Hispanic Students 




Math Eighth Grade NAEP Scale Score Gain 1990-2003: 
Hispanic Students 
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MATH GRADE 8, continued 



Table 8: Correlations of Threat Change and NAEP Gain: White Students 










1990* 1992* 


1996* 


2000* 


2000 


2003 


Threat 

Rating 

Change 

1990-2003 


NAEP Gain 


PRI NAEP NAEP 


NAEP 


NAEP 


NAEP 


NAEP 


1990 (1992) 


White White 


White 


White 


White 


White 


-2003 



PRI 1.000 

1990* NAEP White 0.052 1.000 

1992* NAEP White 0.189 0.387 

1996* NAEP White 0.235 0.414 

2000* NAEP White 0.273 0.471 0.958 0.975 1.000 



2000 NAEP White 0.291 0.477 0.962 0.976 0.995 1.000 

2003 NAEP White 0.247 0.125 0.503 0.500 0.549 0.536 1.000 



Threat Rating Change 
1990-2003 


0.524 


0.024 


0.039 


0.044 


0.129 


0.117 


-0.058 


1.000 




NAEP Gain 1990 (1992) 
-2003 


-0.085 


-0.247 


-0.845 


-0.830 


-0.751 


-0.764 


0.011 


-0.106 


1.000 



* Denotes no accommodations. 

Correlation with two outliers (Hawaii and Missouri) deleted r = .269. 

Partial r = -.098 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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0.988 1.000 










PRI Gain 1990-2003 



MATH GRADE 8, continued 



Figure 8: Scatter Plot of Threat Change and NAEP Gain: White Students 




Math Eighth Grade NAEP Scale Score Gain 1990-2003: White 

Students 
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READING GRADE 4 



Table 9: Correlations of Threat Change and NAEP Gain: All Students 





PRI 


1992* 

NAEP 


1994* 

NAEP 


1998* 

NAEP 


1998 

NAEP 


2002 

NAEP 


2003 

NAEP 


Threat 

Rating 

Change 

1992-2003 


NAEP 

Gain 

1992-2003 


PRI 


1.000 


















1992* NAEP 


-0.331 


1.000 






1994* NAEP 


-0.354 


0.925 


1.000 














1998* NAEP 


-0.282 


0.874 


0.908 


1.000 












1998 NAEP 


-0.366 


0.896 


0.932 


0.985 


1.000 










2002 NAEP 


-0.232 


0.901 


0.855 


0.910 


0.898 


1.000 








2003 NAEP 


-0.288 


0.868 


0.838 


0.903 


0.894 


0.959 


1.000 






Threat Rating 
Change 1992- 
2003 


0.436 


0.023 


0.067 


0.061 


0.030 


0.097 


0.119 


1.000 




NAEP Gain 
1992-2003 


0.085 


-0.261 


-0.173 


0.052 


-0.007 


0.108 


0.253 


0.187 


1.000 



* Denotes no accommodations. 

Partial /■= .157 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Change 1992-2003 



READING GRADE 4, continued 



Figure 9: Scatter plot of Threat Change and NAEP Gain: All Students 




Reading Fourth Grade NAEP Scale Score Gain 1992-2003: All 

Students 
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READING GRADE 4, cont’d 



Table 10: Correlations of Threat Change and NAEP Gain: African American Students 





PRI 


1992* 

NAEP 

African 

American 


1994* 

NAEP 

African 

American 


1998* 

NAEP 

African 

American 


1998 NAEP 
African 
American 


2002 NAEP 
African 
American 


2003 NAEP 
African 
American 


Threat 

Rating 

Change 

1992-2003 


NAEP Gain 
1992-2003 
African 
American 


PRI 


1.000 


















1992* NAEP African 
American 


0.301 


1.000 
















1994* NAEP African 
American 


0.354 


0.825 


1.000 














1998* NAEP African 
American 


0.349 


0.848 


0.997 


1.000 












1998 NAEP African 
American 


0.339 


0.843 


0.998 


1.000 


1.000 










2002 NAEP African 
American 


0.270 


0.679 


0.833 


0.841 


0.839 


1.000 








2003 NAEP African 
American 


0.361 


0.845 


0.996 


0.997 


0.997 


0.856 


1.000 






Threat Rating 
Change 1992-2003 


0.436 


-0.104 


0.226 


0.194 


0.197 


0.220 


0.209 


1.000 




NAEP Gain 1992- 
2003 African 
American 


0.017 


0.308 


0.264 


0.282 


0.275 


0.554 


0.317 


-0.060 


1.000 



* Denotes no accommodations. 

Partial r= -.077 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Change 1992-2003 



READING GRADE 4, continued 



Figure 10: Scatter Plot of Threat Change and NAEP Gain: African American Students 
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Reading Fourth Grade NAEP Scale Score Gain 1992-2003: 
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READING GRADE 4, continued 



Table 11: Correlations of Threat Change and NAEP Gain: Hispanic Students 



PRI 



1992* 1994* 

NAEP NAEP 

Hispanic Hispanic 



1998* 

NAEP 

Hispanic 



1998 

NAEP 

Hispanic 



2002 

NAEP 

Hispanic 



2003 

NAEP 

Hispanic 



Threat 

Rating 

Change 

1992-2003 



NAEP 

Gain 

1992-2003 

Hispanic 



PRI 1.000 



1992* NAEP 
Hispanic 


-0.067 


1.000 




1994* NAEP 
Hispanic 


-0.052 


0.901 


1.000 















1998* NAEP 
Hispanic 



0.061 0.838 0.909 1.000 




2002 NAEP Hispanic 0.156 0.631 0.698 0.774 0.706 1.000 



2003 NAEP Hispanic -0.331 -0.169 -0.058 0.009 -0.047 -0.140 1.000 



Threat Rating 
Change 1992-2003 


0.436 


-0.174 


-0.252 


-0.189 


-0.274 


-0.242 


0.104 


1.000 




NAEP Gain 1992- 
2003 Hispanic 


-0.155 


0.617 


0.560 


0.531 


0.577 


0.414 


0.189 


-0.007 


1.000 



* Denotes no accommodations. 

Partial r= .024 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Change 1992-2003 



READING GRADE 4, continued 



Figure 11: Scatter Plot of Threat Change and NAEP Gain: Hispanic Students 




Reading Fourth Grade NAEP Scale Score Gain 1992-2003: 
Hispanic Students 
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READING GRADE 4, continued 



Table 12: Correlations of Threat Change and NAEP Gain: White Students 

PRI 

PRI 1.000 

1992* NAEP White -0.003 1.000 

1994* NAEP White 0.039 0.894 1.000 

1998* NAEP White 0.113 0.761 0.862 1.000 

1998 NAEP White 0.040 0.784 0.873 0.977 1.000 

2002 NAEP White 0.146 0.779 0.796 0.853 0.846 1.000 

2003 NAEP White 0.102 0.741 0.763 0.818 0.794 0.917 1.000 



Threat Rating Change 
1992-2003 


0.436 


0.016 


0.031 


-0.066 


-0.099 


0.079 


0.123 


1.000 




NAEP Gain 1992-2003 
White 


0.153 


-0.205 


-0.037 


0.215 


0.150 


0.334 


0.505 


0.159 


1.000 



* Denotes no accommodations. 

Partial 1 36 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 





1992* 

NAEP 

White 



1994* 

NAEP 

White 



1998* 

NAEP 

White 



1998 

NAEP 

White 



2002 

NAEP 

White 



2003 

NAEP 

White 



Threat 

Rating 

Change 

1992-2003 



NAEP 

Gain 

1992-2003 

White 
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PRI Change 1992-2003 



READING GRADE 4, continued 



Figure 12: Scatter Plot of Threat Change and NAEP Gain: White Students 




Reading Fourth Grade NAEP Scale Score Gain 1992-2003: 

White Students 
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READING GRADE 8 



Table 13: Correlations of Threat Change and NAEP Gain: All Students 


Threat 


NAEP 


1998* 1998 2002 2003 

IK NAEP NAEP NAEP NAEP 


Rating 


Gain 1998 


Gain 1998 


2003 All 




-2003 


Students 



PRI 1.000 



1998* NAEP -0.186 1.000 

1998 NAEP -0.221 0.988 1.000 

2002 NAEP -0.215 0.882 0.897 1.000 




2003 NAEP 


-0.308 


0.858 


0.879 


0.965 


1.000 






Threat Rating 
Gain 1998 - 2003 


0.309 


0.200 


0.236 


0.257 


0.306 


1.000 




NAEP Gain 1998- 
2003 All Students 


-0.202 


-0.168 


-0.148 


0.233 


0.342 


0.170 


1.000 



* Denotes no accommodations. 

Partial r=.198 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Change 1998-2003 



READING GRADE 8, continued 



Figure 13: Scatter Plot of Threat Change and NAEP Gain: All Students 




Reading Eighth Grade NAEP Scale Score Gain 1998-2003: All 

Students 
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READING GRADE 8, continued 



Table 14: Correlations of Threat Change and NAEP Gain: African American Students 





PRI 


1998* 

NAEP 

African 

American 


1998 NAEP 
African 
American 


2002 NAEP 
African 
American 


2003 NAEP 
African 
American 


Threat 
Rating 
Gain 1998 - 
2003 


NAEP Gain 
1998-2003 
African 
American 


PRI 


1.000 















1998* NAEP African 
American 



0.367 1.000 




2002 NAEP African 
American 



0.275 0.863 0.863 1.000 




Threat Rating Gain 1998 - 
2003 


0.309 


0.141 


0.139 


0.079 


0.227 


1.000 




NAEP Gain 1998-2003 
African American 


0.298 


0.142 


0.142 


0.130 


0.150 


0.109 


1.000 



* Denotes no accommodations. 

Partial r=,08 1 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Change 1998-2003 



READING GRADE 8, continued 



Figure 14: Scatter Plot of Threat Change and NAEP Gain: African American Students 




Reading Eighth Grade NAEP Scale Score Gain 1998-2003: 
African American Students 
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READING GRADE 8, continued 



Table 15: Correlations of Threat Change and NAEP Gain: Hispanic Students 





PRI 


1998* 

NAEP 

Hispanic 


1998 

NAEP 

Hispanic 


2002 

NAEP 

Hispanic 


2003 

NAEP 

Hispanic 


Threat 
Rating 
Gain 1998 - 
2003 


NAEP 
Gain 1998- 
2003: 
Hispanic 


PRI 


1.000 














1998* NAEP 
Hispanic 


0.018 


1.000 












1998 NAEP 
Hispanic 


0.013 


1.000 


1.000 










2002 NAEP 
Hispanic 


0.097 


0.782 


0.783 


1.000 








2003 NAEP 
Hispanic 


-0.272 


0.209 


0.214 


0.311 


1.000 






Threat Rating 
Gain 1998 - 2003 


0.309 


0.316 


0.322 


0.241 


0.381 


1.000 




NAEP Gain 1998- 
2003: Hispanic 


0.192 


-0.198 


-0.199 


-0.115 


0.075 


0.243 


1.000 



* Denotes no accommodations. 

Partial /-.251 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Change 1998-2003 



READING GRADE 8, continued 



Figure 15: Scatter Plot of Threat Change and NAEP Gain: Hispanic Students 




Reading Eighth Grade NAEP Scale Score Gain 1998-2003: 
Hispanic Students 
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READING GRADE 8, continued 



Table 16: Correlations of Threat Change and NAEP Gain: White Students 

1998* 1998 2002 2003 

PRI NAEP NAEP NAEP NAEP 

White White White White 



PRI 1.000 



1998* NAEP White 0.205 1.000 

1998 NAEP White 0.150 0.979 1.000 



2002 NAEP White 


0.241 


0.804 


0.806 


1.000 








2003 NAEP White 


0.113 


0.789 


0.796 


0.886 


1.000 






Threat Rating Gain 
1998 - 2003 


0.309 


0.395 


0.411 


0.413 


0.548 


1.000 




NAEP Gain 1998- 
2003: White 


-0.044 


-0.204 


-0.225 


0.212 


0.411 


0.264 


1.000 



* Denotes no accommodations. 

Partial r=.2 1 7 represents correlation of NAEP Gain Score with Threat Rating Change but with 2003 NAEP exclusion rates partialed out. 
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PRI Change 1998-2003 



READING GRADE 8, continued 



Figure 16: Scatter Plot of Threat Change and NAEP Gain: White Students 




Reading Eighth Grade NAEP Scale Score Gain 1998-2003: 

White Students 
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APPENDIX F: METHOD FOR THE INCLUSION 
OF MEDIA IN PORTFOLIOS 

The process of selecting newspaper stories for inclusion in state portfolios 
involved two major steps. The first step was a two-part pilot process (a) to identify the 
“searchable” universe of media coverage and relevant themes and content of that 
coverage and (b) to determine the feasibility of our measurement strategy across five of 
our study states. The second step grew out of the first and was the systematic application 
of a news media selection strategy for the remaining 20 study states. 

Pilot: Step One 
Exploring Universe of News Documentation 

We started by asking questions such as “What kind of process for news selection 
would yield a good representation of stories in the state?” and “What process will 
minimize coverage differences in states with different numbers of news sources?” One 
approach we considered was to randomly select stories from the entire “pool” of possible 
stories from each search. A random selection process would theoretically equalize the 
story representation across states. However, we worried that this process, while 
theoretically robust for standardizing sampling selection, would skew the thematic 
representation. 

Consider the following hypothetical. If we were to conduct a LexisNexis search 
of all stories available that discuss assessment and accountability in a single state such as 
Utah, it may yield 720 stories spanning January 15, 1994 through February 24, 2004. 
Given the high number of stories overall, some sort of selection procedure must be used 
to reduce that number to a smaller, but representative sample of stories. In this case, one 
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option might be to select every 20 th story, yielding 36 stories to include in the portfolio. 
This decision seemingly ensures that stories are selected to represent what happened in 
that state from 1994 through 2004. However, a review of the content of these selected 
stories suggests that this random selection may produce a poor cross section of the 
content of the stories, thereby biasing the story told about accountability in the state. 

A thematic sampling strategy, while theoretically robust for representing the 
content of issues in any given state, is still practically difficult to employ and does not 
ensure an unbiased selection of stories. Still, it was critical to include in our 
measurement of high-stakes testing pressure the nature and impact of pressure — media 
coverage represents an important venue for describing that impact. Thus, the researchers 
adopted an approach articulated by documentation expert Altheide referred to as 
Ethnographic Content Analysis (ECA).“ In this approach, the researcher interacts with 
the documents and makes “constant comparison(s) for discovering emergent patterns, 
emphasis, and themes.” 3 

ECA follows a recursive and reflexive movement between concept development- 
sampling-data, collection-data, coding-data, and analysis -interpretation. The aim 
is to be systematic and analytic but not rigid. Categories and variables initially 
guide the study, but others are allowed and expected to emerge throughout the 
study, including an orientation toward constant discovery and constant 
comparison of relevant situations, settings, styles, images, meanings, and 
nuances.” 4 

Ethnographic Content Analysis was ideal for this project because it allows the 
reader to make coding and selection decisions based on her interaction with the 
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documents. This is critical because the range of issues/concerns facing individual states 
varied widely, and therefore the selection system had to be flexible enough to capture the 
ongoing changes in reporting styles and content over time and from state to state. This 
qualitative approach “relies on the researcher’s interaction and involvement with 
documents selected for their relevance to a research topic.” 5 

To identify the range of possible themes we would encounter throughout media 
coverage on accountability practice, researchers executed a trial search of stories on 
assessment and accountability in Massachusetts. This search led to a few conclusions. 
First, the sheer volume of possible stories was vast, making the prospect of creating a 
reasonable sampling approach daunting. The search also revealed that story content 
clusters in identifiable ways, making the process of selecting a thematically-relevant 
sample of stories possible. The limits of the database used to search for stories (i.e., 
LexisNexis 6 ) were realized and it seemed appropriate to supplement all searches with an 
additional one using a separate database (i.e., Google 7 ). Lastly, researchers supplemented 
all general searches with one that focused specifically on consequences to students, 
teachers, administrators, and schools. Since the study relied on the measure of “pressure” 
associated with stakes attached to test performance, it seemed reasonable to perform a 
search that directly looks for coverage on this issue. (A description of how stories were 
selected for the Massachusetts portfolio is available in Appendix G.) 

Pilot: Step Two 

Armed with a selection rationale and a general idea of what researchers faced in 
their searches, a more “systematic” pilot process was developed to explore the range of 
news coverage of five states (AZ, AL, ME, MD, and NC). This pilot had two goals. 
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First, to test the comparative judgment process, it was necessary to build portfolios using 



some kind of newspaper selection process in order to test the feasibility of the overall 
approach to the measure of “pressure.” 8 In doing so, a few portfolio pairs were shared 
with voluntary participants to see (a) if it was even possible to make a judgment between 
two states and (b) to see how long it would take a reader to go through each portfolio. 

We selected two state pairs to pilot — one that was “close” (e.g., North Carolina and 
Arizona) and one that was “far” (e.g., Maine and North Carolina) in their hypothesized 
levels of pressure. Our goal for the “far” pair was to see if an independent reader would 
judge the pressure difference in a predictable way, and the answer was yes. In the case of 
the “close” pairing, we wanted to know whether it was even possible to make a 
decision — was one state higher in pressure when their policies looked relatively similar? 
Again, the answer was yes — readers were able to make a decision. We also found out 
that it took an average of two hours to read through both portfolios. The results of this 
pilot were encouraging and prompted us to move forward with the creation of the 
remaining portfolios. 

A second goal of this pilot was to refine the sampling procedure for including 
news stories in each portfolio. Prior to putting together any portfolios, it was impossible 
to understand the range of issues that might emerge or how to select from among them. 
Therefore, the search procedure — guided by ECA — was “piloted” in these three states, 
out of which grew a more systematic strategy for identifying, coding, and selecting 
stories for portfolio inclusion. 
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Getting Started 



A search of each state’s news documentation was approached with special 
attention to the timing and overall number of stories produced by each search. Initially, it 
was believed that each search could be standardized — that is, we would use the same 
“search string” term to scan for relevant articles in each state. 9 For example, in this 
study, it was important to find any story containing keywords such as “assessment” 
“accountability” and “high-stakes testing.” Thus, searches using the string: “assessment 
and test and high stakes” would yield any story drawn from the pool of news sources 
containing these three words. It was impossible to use the exact same search string for 
every state for two reasons. First, each state had its own vernacular around assessment 
and accountability. Some states had specific acronyms for their state (e.g., Massachusetts 
had the MCAS, Maryland had the MSPAP), whereas others had no acronym, but 
discusses it in terms of “testing” or “assessment.” Thus, it was necessary to play around 
with varying search string combinations to yield, at least initially, the widest pool of 
stories available. Second, some states simply had coverage that was too extensive. For 
example, a broad search in Massachusetts initially yielded over 1,000 documents. Thus, 
each search was unique to each state. 

Once a reasonable number of stories were produced (e.g., no more than 600), the 
headlines were reviewed for topic relevance and irrelevant stories were immediately 
discarded. For example, many times, stories gleaned from searches incorporating the 
search term “test” were about testimonies in recent trials. Similarly, in reviewing the 
initial pool of documents, often there are multiple stories covering a single event. For 
example, when SAT scores were released, a search of stories in a state such as 
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Massachusetts (where many newspapers are included in LexisNexis) would produce 



upwards of 20 stories reporting the same SAT results. Repetitive stories that failed to add 
any new information were also discarded. 

Two main goals of the searches with these first five states were (a) to gain more 
experience interacting with this type of coverage and (b) to begin to conceptualize 
overarching themes that might capture the range of ideas presented in them. As a result, 
the selection process for the remaining states was further refined. Specific procedures 
used for these five states and how sample selections were made for portfolio inclusion are 
described in Appendix H. 

Method for Newspaper Inclusion: Finalized Selection System 

The final procedure used for compiling newspaper documents for all remaining 
portfolios included the following steps. First, researchers reviewed all of the available 
documents on the state’s department of education website. Typically, state websites 
contain detailed information on the accountability laws and the timing of when they were 
passed. This information provided the appropriate search terms that would yield a 
substantial pool of stories from which to review and select. Second, relevant search 
string terms were used to search for a pool of news stories. Once identified, the larger 
pool was then reviewed for topic content and relevance out of which a shorter, more 
manageable list of stories were downloaded for more careful review, coding, and possible 
selection for portfolio inclusion. 10 A description of the rationale used to search and select 
news stories for each of the remaining states is described in Appendix I. A review the 
categories that guided this sampling procedure follow. 



Page 164 of 336 

This document is available on the Education Policy Studies Laboratory website at: 

http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0509-105-EPRU.pdf 





These searches, which focused on the past 15 years, produced hundreds of stories 
through which identifiable themes emerged. For the remaining states, we drew on these 
themes were used to guide the sampling process. Themes are characterized by four main 
foci: legislative (L), reporting/documentation (R), opinion/reaction (O), and personal 
interest (PI). In addition to the primary themes, most stories could also be qualified in 
one or two ways. First, articles generally had a specific affective “tone” that could be 
positive, negative, or neutral. Second, articles had a general “voice” (i.e., statewide, 
localized, or both). A more detailed discussion of these and the broader categories are 
described next. 

Legislative 

Stories with a “legislative” categorization include any articles that discuss 
legislative activities. Researchers came come across three primary “legislative” themes 
in the news, including “voting/decisions (v),” “legal/debates (1),” and 
“proposals/initiatives (p).” “Legislative” stories are subcategorized as including votes or 
decisions (L/v) when they report on legislative or some governing panel’s voting 
patterns. For example, in 1995 in Rhode Island, a local school committee voted to hold 
principals accountable for students’ reading scores. In 1995 in Virginia, the state school 
board adopted a plan to raise student achievement. Among its many goals were to 
increase students’ average SAT scores and to make schools more cost efficient. In 
Hawaii, in 2000, the state legislature voted to approve a new accountability bill: 

The bill requires a system of statewide performance standards for students, an 
annual assessment in core subjects for each grade level and continuous 
professional growth on the part of teachers and administrators. 11 
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A second “legislative” theme is one that articulates legislative proposals (L/p). 
Many newspaper articles, especially prior to stories documenting voting patterns, 
reported on the proposals or initiatives that set up the vote. For example, in 1992, a pay- 
for-performance proposal was up for a vote in one California school district: 

A unique contract that links teacher pay increases to improved student 
performance is up for approval tonight before the Redwood City Elementary 
School District board. 

The proposal, already approved in concept by the teachers union, will take 

force only if voters back a new $ 4.5 million annual parcel tax that is expected to 

12 

be put on the ballot next year. 

In Virginia, a debate was sparked when a national proposal was discussed and how it 
might affect students in Virginia: 

Rep. Robert C. Scott said he will introduce legislation barring states and school 
systems that get federal funds from requiring students to pass standardized tests to 
graduate. 

If it is passed, the bill could drastically change Virginia's Standards of 
Learning system. Starting with the graduating class of 2004, students will have to 
pass at least six of the 11 high school [Standards of Learning] SOL tests to 
receive their diplomas. They will be able to take the exams an unlimited number 
of times. 13 

A third “legislative” theme is broadly defined as legal concerns/debates (L/l). 

These types of stories present a legal issue that might or might not be officially proposed 

for a vote, but do articulate both sides of the debate. Lor example, in 1993, there was an 
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article in California outlining Proposition 174 — a voucher initiative. In this example, the 
story recounts both sides of the debate as well as the voting time line. However, it does 
not, by virtue of timing, report on the voting outcome. These types of stories are 
important to categorize and include as they often present both sides of an important 
accountability-related issue — even if they are not officially voted into practice. 

Importantly, stories under the broader “legislative” category (and under any 
subcategory of voting, legal, or proposal) can also be characterized by affect or tone 
(positive, negative, or neutral) and voice, audience, and/or geographic focus (local, state, 
or both). These sub-categorizations are included in the coding scheme so that decisions 
to include “legislative” stories represent a wider range of reporting. Thus, stories were 
selected that represent both positive and negative viewpoints as well as those that speak 
to larger and smaller audiences (e.g., does the proposal/debate concern all students in the 
state, or is it isolated to a local community in which the newspaper is distributed?). 
Decisions to include “legislative” stories in each state’s portfolio were made to represent 
the cross section of these secondary categorizations. 

Reporting 

A large number of stories were “reporting” in nature — e.g., how students did on 
recent statewide assessments. In these stories, reporters provided results of student 
performance by way of percentages of students passing/failing or percentages of students 
scoring at various levels of proficiency. Stories with a “reporting” theme were further 
identified as “research (r),” “scores/performance levels (s),” or “policy (p).” 

Stories identified as “reporting” and further identified as “research” (R/r) included 
any stories that reported the results of national or local research. For example, most 
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states had at least one story dedicated to Ed Week’s 14 analysis of each state’s 
accountability system. Other kinds of “reporting” on research included instances where 
local educational researchers published studies relevant to the area. For example, many 
researchers have published studies investigating the dropout issue in Texas and the Texas 
Miracle. These kinds of stories would be labeled as “reporting” on research results (R/r). 

Reporting stories also focus on student scores or school performance levels (R/s). 
For example, every state had a barrage of stories that reported on how students did on the 
latest round of assessments. In November of 2003, Virginia reported, “Va. Students 
Improve Performance On SOFs/ 23 Of Richmond's 55 Schools Are Now Fully 
Accredited, Up From 10. ” 15 In Connecticut in February 2004, it was reported, “Officials 
Cheer As Students Stand Out Among Peers In State.” 16 Not only are reports on how 
students fared included in this category, but also how schools performed on the state’s 
accountability system. For example, in October 2002 in California, it was reported, 

“Two San Bernardino schools are among 11 chosen for academic audits by the state 

17 

because they failed to meet Academic Performance Index goals four years in a row.” 
Importantly, based on the headlines above, these stories can be further characterized by 
tone (positive or negative) and audience (state versus local). 

A final “reporting” category is indicated by a “policy” viewpoint (R/p). This 
category was loosely defined as those stories that did not fit in any of the categories 
defined above or those under the “legislative” category but which document varying 
viewpoints in the state. For example, in Hawaii in April 2002, there was a story that 
discussed the administration of Hawaii’s standardized test. This article is important to 
include because it provides some details on the nature of the state’s assessment system: 
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The test being given to 55,000 students, the first of its kind, is a key element in 



the state's school reform movement. 

The test will provide a baseline score to judge how well Hawaii students 
and campuses are performing in reading, writing and math. Two of the seven 

1 R 

sections come from the national Stanford Achievement Test. 

As well as why students had not taken the test the previous year: 

Hawaii public school students in grades 3, 5, 8 and 10 this month are taking a new 
Hawaii-based standardized test that was postponed from last year because of the 
statewide teachers' strike. 19 

In New York, a series of “reporting” stories identified as “reporting on policy” 
discussed the merits of certain kinds of policies, but the series does not officially 
document a legislative proposal or vote or decision. For example, in 1999, one story 
discussed New York’s state commissioner’s disappointment with how the state’s 
curriculum was being administered: 

When Richard P. Mills came to New York as its Education Commissioner three 
and a half years ago, the state had just drafted a detailed set of blueprints, 
contained in thick bound volumes, for how to teach nine subjects from English to 
science in every grade from pre-kindergarten through high school. 

But as he visited schools from the South Bronx to Buffalo, Mr. Mills was 
dismayed to find that the plans, called "curriculum frameworks," had made almost 

90 

no impact in the trenches." 
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Another 1999 article predicts high numbers of student failures on an upcoming Regents 



exam: 

With just a year to go before high school students must pass a tough new English 
Regents test to graduate. New York State education officials released test results 
yesterday showing that more than a quarter of all seniors - and more than a third 
of those in New York City - would have failed if the requirement had been in 
place last year. 21 

The purpose of this category is to describe those stories that are related to accountability 
policies and that might discuss aspects of the laws, or specific viewpoints, not found in 
stories that are better characterized by the above categories. 

Opinion/Reaction 

Another primary category assigned to stories was identified as opinion- or 
reaction-oriented (O). These stories reported on individuals’ or groups of individuals’ 
perspectives on accountability practices in the state. These kinds of stories included 
editorial commentaries put forth by the newspaper, write-in opinion pieces (instances 
where citizens wrote in to the newspaper to provide their perspective on an 
accountability-related practice), or “reaction-oriented” articles (opinion-laden viewpoints 
from the perspective of individual staff writers). 

Personal Interest 

Personal interest was a category created to fit any type of story that focused on 
individual experiences and which didn’t fit into any of the above categories. 
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APPENDIX G: SUMMARY NEWS SEARCH: MASSACHUSETTS 



Because of the sheer volume of stories appearing in the Massachusetts press over 
the previous 10 years covering anything related to educational policy, it was necessary to 
conduct searches restricted to shorter time frames in order to yield a more manageable 
number of stories from which to review. Thus, “logical” decisions were made about the 
time frames based on an overall description of how educational policy evolved in 
Massachusetts. In this approach, the thematic events occurring over time informed 
subsequent decisions on how to make the search more manageable. 

The search started with general searches over the course of the past 10 years to 
get a “feel” for the ebb and flow of educational coverage — specifically as it relates to the 
state’s assessment and accountability policies. Out of this cursory overview emerged a 
multi-step search strategy to cover story content and range. What follows is a description 
of the searches separated by time, each containing a “logical” rationale for the decisions 
that were made for including articles in this specific portfolio. 

Search One 

Massachusetts’s school reform act was passed in 1993. This initial act was 
subsequently revamped and updated in 1999. An initial search between January 1, 1990, 
and December 31, 1996 (looking for any articles that talked about tests, school reform, 
and education) yielded 177 hits. Many of these 177 stories were irrelevant to education 
(e.g., there were many stories on the music industry — the “MCA” label specifically) and 
were therefore discarded, leaving 14 stories for more careful review. Of these 14, one 
story was included in the portfolio that represented the range of issues during this time 
period. This story outlined the provisions of the initial education reform bill that was 
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subsequently passed by both the house and the senate and then signed into law by the 



governor. Thus, this story sets up the initial educational reform policy in Massachusetts 
for the reader. 

Search Two 

Stories on the statewide assessment system, the Massachusetts Comprehensive 
Assessment System (MCAS), began to appear in 1997. Therefore, a second search 
included the timeframe of the first administration of the MCAS (which was first given in 
the spring of 1998). Thus, the second search looked for any article including the 
acronym MCAS as well as any other terms such as test, accountability, or high stake. 22 
During this search, the main goal was to analyze the timing and progression of stories 
relevant to the MCAS since its inception. This search was confined to the time period of 
January 1, 1997 (searches for MCAS prior to this date produced no results) to January 1, 
1999. Choosing this time frame was important because it covered the time period during 
which the first administration of MCAS was given and it includes the reporting phase of 
these initial results. 

This search yielded a total of 368 stories. Irrelevant stories were eliminated, 
leaving 278 stories to review more closely. There were too many stories to go through 
during this time period to make a reasonable judgment of which ones to include — 
especially without a system for characterizing the range of themes covered. To best 
represent this larger pool of stories, a selection of letters to the editor written by students 
that appeared during the time when MCAS was first administered was included, as was a 
selection of stories prior to the release of the initial test results. 
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Search Three 

Following January 1, 1999, and the enactment of an official accountability 



system, a tally of the number of articles covering MCAS and issues related to high-stakes 
testing was taken for every month through November 2003 to get a feel for the general 

'yi 

population of stories in existence and to see what, if any kind of pattern in reporting 
existed (Table 1). 



Table 1: Tally of News Stories on MCAS in Massachusetts 24 



Month 


1999 


2000 


2001 


2002 


2003 


January 


93 


110 


133 


60 


72 


February 


54 


107 


63 


60 


85 


March 


90 


107 


94 


105 


116 


April 


78 


133 


150 


80 


118 


May 


85 


147 


140 


92 


152 


June 


91 


92 


90 


84 


112 


July 


50 


56 


68 


52 


62 


August 


51 


73 


70 


55 


55 


September 


100 


101 


62 


208 


115 


October 


89 


101 


139 


192 


109 


November 


126 


191 


157 


124 


40 


December 


168 


144 


67 


124 


N/A 



NOTE: Top three reporting months bolded for each year. 



Although it is clear some months consistently had more coverage than others 
(e.g., November — when test results were released, May — when tests were administered), 
the total number of stories from 1999 through 2003 precluded a systematic and timely 
study of their contents. Therefore, a different system was adopted to represent the range 
of issues in Massachusetts. 
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Tone of Testing In Massachusetts 2000-2003 



Instead of coming up with a system to catalogue such a large number of stories, 
summaries of weekly stories compiled by a researcher in Massachusetts were used for 
this portfolio. Anne Wheelock catalogued and summarized news stories that discussed 
education reform and MCAS sporadically from May 2000 to July 2003. Her summaries 
include an anecdotal summary of the week’s news events as well as cut and paste 
snapshots of these stories. What is represented in the portfolio is a selection of these 
stories and her summaries during this time period. 

Supplemental Search: Google 

To represent the most recent “tone” in Massachusetts, a Google search was 
conducted for all newspapers and wires in Massachusetts for the previous 30 days. These 
newspapers were scanned and those that discussed consequences associated with MCAS 
during this time frame were included in the portfolio. 

Supplemental Search: LexisNexis 
The researchers conducted a LexisNexis search over the previous year to look 
specifically for stories related to the implementation of consequences to teachers and 
schools in Massachusetts. Specifically, they looked for stories where the state “took 
over” a school or district as well as a search of rewards (financial, public recognition) 
being given to teachers, schools, or districts. A search of state takeovers yielded 51 
stories — a selection of these was included in the portfolio. A search over the previous 
year for stories related to teacher or administrator bonuses, rewards, or incentive pay 
yielded 290 stories. However, most of these stories were not about public recognition or 

Page 174 of 336 

This document is available on the Education Policy Studies Laboratory website at: 

http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0509-105-EPRU.pdf 





rewards, but rather about teacher contract negotiations and business relationships. 



Therefore, none were included in the portfolio. 
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APPENDIX H: SUMMARY OF NEWS SEARCHES 
IN FIVE PILOT STATES 

Arizona 

Arizona’s assessment system for making accountability decisions is the Arizona 
Instrument for Measuring Standards (AIMS). Therefore, we conducted a search for the 
acronym AIMS (and included other search terms such as test, accountability, and high 
stakes) using the LexisNexis search engine.' AIMS was the primary search term used 
because it was an assessment specifically created to address accountability mandates and 
was a relatively new assessment system. Stories including this search term would 
represent the most recent five to six years of accountability practices. 

There were 416 stories found in this initial search spanning 1998 through 2003. 
After irrelevant and redundant stories were eliminated, a total of 1 8 1 stories were 
carefully reviewed for content and possible inclusion in the state portfolio. The number 
of stories in each year is presented in Table 1. 



Table 1: Stories Emanating From a Search for the Term AIMS 



Year 


Number of 
Stories found 


Number of Stories 
Carefully Reviewed 


1998 


45 


18 


1999 


78 


34 


2000 


161 


53 


2001 


59 


35 


2002 


45 


28 


2003 


28 


13 
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Using time as a unit of analysis for conducting these searches yielded a 
manageable set of news stories from which to review and select for inclusion in the 
portfolio. For each year, a sample of stories was selected for inclusion in the portfolio to 
represent the range of issues during that particular time frame. What follows is a general 
summary of the content of these stories by year. 

1998 

During this time period, the AIMS test was first introduced into public debate. 
Towards the end of the year, there was growing concern and debate over whether it 
should be used as a graduation requirement. The Arizona legislature passed a bill that 
required the class of 2001 to pass it in order to receive a diploma. However, by the end 
of the year, many concerns were raised about whether districts were ready to prepare 
students to pass it. The state legislature put it off as a requirement for one year. Initially, 
it was required for the class of 2001, but by the end of 1998, it was required for the class 
of 2002. 

1999 

The state superintendent of instruction (Lisa Graham Keegan) wanted the school 
year extended to offset the time needed for students to take the new AIMS test. The issue 
of social promotion was also in the news, but it never passed a legislative vote. In a story 
published on May 4, 1999, the house and senate could not agree on a bill requiring third- 
and eighth-graders to pass AIMS in order to be promoted to the next grade. However, an 
earlier version of the bill that was passed a week earlier provided more latitude to 
students. In this bill, the requirement was for third graders only and was to be delayed 
another year. Further, promotion decisions were not tied to AIMS performance only — 
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districts and schools could make promotion/retention decisions on any assessment of 



their choice. Both of these resolutions died in the legislature. 

The results from the first administration of AIMS were released (on Monday, 
November 15, 1999) to widespread concern. Only 11 percent of students who were 
sophomores in 1998 when they took the exam passed the math portion on the first of five 
tries. When results were disaggregated, they showed that only 3 percent of African 
American, Hispanic, and American Indian students passed the math portion in 
comparison to 14 percent of Whites and 18 percent of Asians. As a result of these poor 
passing rates in math, there was public concern over whether the bar was raised too high 
in math — were we setting students up to fail? 

2000 

A judge rejected an argument that AIMS discriminates against minority students. 
A bill was passed that students’ best AIMS scores must be published on their transcripts. 
In May 2000, Keegan proposed another delay for AIMS as a graduation requirement. 

She wanted to postpone it from 2002 to 2004 — but just the math portion. The class of 
2002 and 2003 would still have to pass the reading and writing portions. This proposal 
was never voted on. Keegan eventually left her position in Arizona and this decision was 
passed to her successor, Jaime Molera. 

2001 

In August 2001, AIMS was officially postponed as a graduation requirement for 
the class of 2006. 
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2002 



Two bills were passed. The first allows the state to assign contractors to poor 
performing schools. According to this report, prior to this resolution, the only “real 
sanction now in the state law would be a possible loss of state funding” if schools 
continued to fail. This new bill allowed the state to assign new management to the 
school. Another bill defined how districts could distribute prop 301 monies — this bill 
would “bar districts from basing performance-pay increases funded by voter- approved 
sales tax increase on a single measurement and require that plans within three years 
include incentives for individual teachers based on student performance.” 26 The house 
and senate also approved a measure that allows the state to engage in a school takeover 
policy if schools are labeled as “under performing” for two or more years. 

2003 

New standards were adopted. Parents were urged to ignore “take your 
son/daughter to work day” in order to keep students in school to prepare for AIMS. New 
laws were discussed that empower the state to take over a school if it is underperforming 
for two or more years. 

AIMS results from 2002 were released (September 2, 2003) to continued concerns 
that too many students were failing the math portion. And the superintendent of 
instruction publicly predicted that the public should expect 10 percent of the graduating 
class of 2006 to fail the AIMS test (this will be the first class who must pass it to get a 
diploma). Lastly, the legislature approved a bill to combine AIMS and Stanford 9 testing 
to minimize testing overlap to students. However, the lawmakers were not clear on how 
this would be accomplished. 
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Supplemental Search: Google 



A search was conducted on December 10, 2003, covering the previous 30 days. 
This search (using the search terms AIMS and test) yielded 29 stories. A selection of 
these was included in the portfolio. 

Supplemental Search: LexisNexis 

A search was conducted using LexisNexis over the previous year (2003) looking 
for stories of state-imposed consequences. This included a search of stories of rewards 
(teacher bonuses, pay for performance, any story highlighting school- or teacher-level 
successes) as well as sanctions (state takeover or state reorganization of a school). A 
selection of these was included in the portfolio. 

Alabama 

27 

A search using LexisNexis search engine was conducted to look for high- stakes 
stories in Alabama. This search yielded 539 hits spanning from March 2, 1999, through 
February 12, 2004. These 539 stories were reviewed for content and relevance. 

Duplicate and irrelevant stories were eliminated from consideration. Some highlights 
from stories that were carefully reviewed: 

• Several earlier stories had to do with plans to implement a new teacher 
testing program; 

• The first school intervention was in 1999; 

• In January 2000, there were debates about the strength of Alabama’s 
overall accountability system, reports on survey studies showing how 
Alabama’s standards and accountability system rates against other states’, 
and a public debate over the merits of exit exams; 
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• There was also a public debate about pay for performance. Tying 
accountability measures, such as teacher pay, to student performance; 

• Throughout 2000, articles from the spring and fall discussed the strength 
and weaknesses of education as expressed in the publicized report cards. 
Also, some comments on how “good” these reports are for measuring 
school progress; 

• January 2001 — No Child Left Behind comes into action and articles began 
to discuss its merits; 

• In June 2001, there was an article reporting that Alabama could lose Title I 
funds ($137 million), if they do not change their assessment system. 

Thus, there were many articles throughout the second half of 2001 
discussing the abandonment of SAT; 

• June 2002 — seniors now also have to pass a social studies component to 
the exit exam. 

It was important to represent how accountability unfolded in Alabama. The initial 
search of 539 stories was reduced to a total of 138 stories through which a more thorough 
examination of story contents was made. Stories chosen for inclusion in the portfolio 
were made based on two units of analysis (a) time frame and (b) story content. 
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Time and Content 



Stories ranged from March 1999 through February 2004. A tally of the number of stories 
that were carefully reviewed and disaggregated by year is displayed in Table 2. 

Table 2: Number of Stories by Year in Alabama 



Year 


Number of Stories 


1999 


9 


2000 


37 


2001 


26 


2002 


17 


2003 


29 


2004 


2 



Examination and inclusion of stories was characterized by three two-year time 
frames: 1999-2000 (n=46); 2001-2002 (n=43); and 2003-2004 (n=31). These time 
frames were chosen simply because they reduced the number of stories to a manageable 
set of stories to review. Based on these time frame units, stories were then selected for 
portfolio inclusion based on their content. A concerted effort was made to select stories 
to represent the range of issues evident in Alabama during that time period. An overall 
summary of the stories across these three time units are described below. 

1999-2000 

As of March 1999 the Stanford 9 was given to students in grades 3-11. Based on 
performance on this single test, schools were labeled and if progress was not made, 
schools were subject to state takeover. Although students had been taking an exit exam 
as long ago as the mid 1980s, the 10 th grade students in the spring of 1999 were about to 
take a practice version of the new exit exam — created to be harder than earlier versions. 
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The new one reflected 1 1 th grade skills, three grades above what the older exam tested. 
There was fear that the new graduation exam, thought to be more difficult than the 
Stanford 9, might prompt an increase in numbers of schools eligible for state takeover for 
decreasing student achievement. 

Throughout 2000, a majority of stories focused on the new exit exam that was 
given to 1 1 th graders for the first time. There were public debates over whether test 
performance should be tied to a diploma or whether it should be delayed. Further, there 
were stories about schools that had been taken over by the state and schools that had 
received rewards for making academic improvements. Several stories covered the release 
of statewide report cards publicizing to community members the quality of their local 
schools. Also, there were several stories covering recent national reports ranking states’ 
accountability systems. 

2001-2002 

Throughout 2001, there were stories that discussed changes to Alabama state laws 
for how students would be assessed. In general, the state abandoned the use of Stanford 9 
(SAT9) as an accountability measure to be in compliance with federal guidelines. There 
is in fact an article stipulating that federal funds could be withheld if the state did not 
make changes to its assessment and accountability program. Thus, most of the stories 
during this time focused on these transitions. Similarly, there were a few stories that 
discussed how school report cards would include student performance disaggregated by a 
variety of demographic characteristics including race, poverty, and migration status. 

Again in 2002, there were stories discussing the new accountability system in 
Alabama as well as many stories reporting on students’ performance on the first wave of 
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the fifth- and seventh-grade writing exams, which for the first time, would be used along 
with SAT9 performance to make accountability decisions. 

2003-2004 

Throughout much of 2003, many of the stories focused on the Governor’s tax plan 
to offer scholarships to high school students. The scholarship bill, which would apply to 
Alabama's high school graduating class of 2004, would require students to graduate with 
a "B" average, complete 18.5 course credits, including two units in the same foreign 
language, and score at least a 20 on the ACT college entrance test. Once in college, 
students would have to maintain a "B" average to retain free tuition and mandatory fees. 
However, in the fall of 2003, this bill was resoundingly defeated in a public vote. 

A barrage of stories reported on how students scored on the last round of writing 
exams. Based on these results, it was clear that many schools would be eligible for state 
takeover/intervention; however, this process was unlikely to occur given the state’s 
financial crisis. A separate story described the writing test that fifth and seventh graders 
take and how students recently performed on it. 

Supplemental Search: Google 

A search was conducted on February 18, 2004, covering the previous 30 days. 

Supplemental Search: LexisNexis 

A search was conducted over the previous year using LexisNexis.” The purpose 
of this search was to conduct a concerted search over the most recent time frame for 
accountability-related stories and to look for consequence-specific stories. This search 
yielded 198 overall hits of which 13 were kept for review after eliminating unrelated and 
duplicate stories. All of these are included in the portfolio. 
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Maine 



An initial search was conducted to look for any articles discussing Maine’s 
statewide assessment system (Maine’s Educational Assessment or MEA). An initial 
review of these articles suggested that reports on student achievement did not appear until 
about 1997. Therefore, the search strategy for Maine was dissected into three parts 
defined by time: (1) 1990-1999, (2) 2000 - 2002, and (3) 2003. Further, a search for the 
past year (2003) looking for any stories related to consequence-based actions throughout 
the state based on student performance was conducted, specifically looking for stories on 
sanctions — school-level reporting, takeover and rewards — teacher, administrator-level 
bonus, rewards and/or incentive pay distributions. All of these searches were conducted 
using LexisNexis. 30 
1990-1999 

A search confined to this time frame yielded 253 stories on Maine’s assessment 
and/or accountability system. Of these, redundant and irrelevant stories were eliminated, 
leaving 122 of the most relevant for more careful review. Eight stories were selected for 
inclusion in the portfolio. Stories were selected to represent the most prominent themes 
during this time. There were stories exploring how well students were doing on the 
MEA. More specifically, administrations of the MEA prior to 1995 seemed to yield 
positive stories of how students were doing generally on statewide standards. However, 
in 1995 the MEA was changed to include more open-ended items (prior versions of MEA 
included at least half multiple choice opportunities). Fourth graders did not perform as 
well on the 1995 administration. Eighth graders did okay, and stories were more 
moderate in their coverage. 
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2000-2002 



A search confined to this time frame yielded 131 stories on Maine’s assessment 
and/or accountability system. All of these stories received a careful review for content 
and story themes. Six stories were selected for inclusion in the portfolio. January 2000 
started with a story about teacher certification and teaching skills assessments. In 
November 1999, schools and students received administration of MEA results. Around 
February 2000, reports emerged comparing how schools performed on the MEA. During 
the summer of 2000, an article discussed one district’s proposal to pilot a pay for 
performance plan (a follow-up story could not be found). On January 1, 2001 the 
newspapers started to pay attention to a bill that would link MEA performance to 
receiving a high school diploma. There were multiple stories discussing how Maine was 
going to align their pre-existing assessment and accountability system with the new 
federal law — No Child Left Behind. 

2003 

A search confined to 2003 yielded 52 stories. All of these stories were reviewed 
for content and thematic emphasis, and eight were included in the portfolio. At the start 
of the year, an article discussed state department of education official’s criticisms of No 
Child Left Behind. According to the article, superintendents were worried about the 
unintended outcomes of the law that required all students to meet a level of academic 
“proficiency” in a specified amount of time. One superintendent was "very concerned" 
the U.S. Department of Education would not allow the state to use a variety of local 
assessments, such as portfolios and projects, along with the MEA to determine adequate 
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yearly progress. Indeed, Maine is “negotiating with the federal government about how it 

o i 

plans to put the No Child Left Behind provisions into place.” 

At least six stories through the spring of 2003 lamented the problems schools had 
meeting academic goals. In one article, it was noted that “twenty-four Maine schools 
have been identified as having the greatest need for improvement because students did 

IT 

not meet the state standards for four years.” ~ In follow up articles, individuals worried 
about the repercussions of not making adequate yearly progress. In April, one article 
noted that: 

Hundreds of Maine schools could be identified as failing in the next few years 
under the federal education reform law known as the No Child Left Behind Act, 
says the state's newly appointed commissioner of education. ‘Every school has 
the potential to fail’ under the new law, said Commissioner Susan Gendron, since 
many children start school with significant literacy problems, and research shows 
they are unlikely ever to catch up. 33 

In response to widespread concern over the number of schools failing to make 
progress, a noticeable change in the tone of stories took place, noting how the changes in 
the assessment system were positive. 

Several follow up stories in late spring 2003 discussed the possibility that Maine 
would ask the federal government to opt out of No Child Left Behind because of its strict 
mandates. 

There were a few headlines announcing the successes/failures of students. One 
headline read, ‘“Good list’ also singles out schools: The state publicizes schools that 
score high or show improvement” 34 and another one noted, “Schools Get News Today On 
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‘Failings’: About 25 percent of Maine schools made the state's preliminary list of low- 

it 

performers, a federal tool to raise standards and improve accountability.” A selection 
of these stories that represent the range of positive and negative reporting as well as the 
scope of issues Maine faces is included in the portfolio. 

Supplemental Search: Google 

A search was conducted on December 8, 2003, covering the previous 30 days, in 
an effort to find stories throughout major and regional news sources for anything related 
to MEA and student assessment. This search yielded a few stories related to assessment 
and accountability in the state (these are included in the portfolio). 

Supplemental Search: LexisNexis 

A search was conducted to look for stories of the state-imposed consequences to 
schools, teachers, and/or students based on statewide assessment performance. A search 
looking for rewards or bonuses (or incentives) tied to student performance yielded no 
relevant stories. A search for school takeover or reorganization yielded six hits, all of 
which covered a story of reorganizing a school district that was undergoing major 
constructive renovations — not relevant to student performance. 

Maryland 

The most logical place to start searching for articles on educational accountability 
in Maryland was to look for any news on the Maryland School Performance Assessment 
Program (MSPAP) — the first set of assessments in the state during the 1990s. Looking 
over the entire LexisNexis universe, a search of MSPAP yielded 359 documents spanning 
Lebruary 1994 through November 2003. All articles that were unrelated to educational 

accountability and those that were redundant were eliminated, reducing the pool down to 
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93. These stories were reviewed carefully for inclusion in the portfolio. These 93 stories 
were further disaggregated by year and were included in the portfolio to represent the 
major themes of each year. The primary themes are summarized below. 

1994 

There were six stories related to the MSPAP. Not surprisingly, all of them had to 
do with how students did on the first round of testing with the new set of assessments. 
Overall, the reports were dismal — many students had failed. 

1995 

There were four stories related to the MSPAP. Again, following a second wave 
of testing, most of the reports were about how various schools had improved over the 
previous year’s showing (3). The fourth story had to do with the high school assessment 
and whether it should be counted as a graduation requirement. 

1996 

There were six stories related to the MSPAP. Story 1 was about how decreasing 
class sizes were related to score drops in one school; Story 2 argued how the MSPAP 
tests are biased against minority students; Story 3 discussed that art and music might be 
dropped from a school’s curriculum in order to increase efforts on math and reading and 
to raise test scores; Story 4 was about how a couple of schools lost Title I funding for 
failing to make academic progress; and the last two stories centered on teachers and (a) 
how they are responsible for test score gains and (b) their agitation at being left out of the 
accountability decision-making process. 
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1997 



There were 10 stories from this year, but one story was deleted due to insufficient 
information, leaving a total of nine. Six of these nine stories were reports of the poor 
achievement of schools and students, two were letters to the editor written by parents 
lamenting the fact they do not have access to MSPAP scores, and one was a story about 
the recognition and rewards a school received for increased student achievement. The 
portfolio has (a) the story on the reward (given it is the only positive story), (b) one 
editorial (randomly selected), and (c) two stories on student’s declining achievement 
(randomly chosen). 

1998 

There were 13 stories from this year. Of these 13, five centered on how students 
performed on the last round of testing, four were on the problems with MPSAP, and four 
were stories about what schools were doing to try to improve their students’ test 
performance. One from each of these categories is included in the portfolio. 

1999 

There were 12 stories from this year. Stories ranged from reporting on how 
schools performed on previous waves of assessments, to several on rewards and sanctions 
schools had received as a result of improved/declining performance. There were also 
some policy-oriented articles discussing how to assess students with limited English 
proficiency as well as whether to tie test performance to graduation requirements. Two 
stories are included from this time period — one on the positive consequences schools 
received and one on the negative ones. 
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2000 



There were only seven relevant stories from this year — six of which reported on 
the good news of increased student performance on the most recent wave of testing. The 
only negative story was about how some parents, fearing the impending consequences to 
schools and to their children based on how well they did on the exam, kept their children 
home on test days. This story was included along with a random selection of one of the 
positive stories. 

2001 

Seven stories from this time period showed up in the search, including a mix of 
positive and negative views on MSPAP testing. Some schools had done well and were 
praising the use of MSPAP, whereas others, like one elementary school, was holding a 
“rally” of sorts where the principal was trying to keep the morale of her staff upbeat in 
light of receiving very low test scores. 

2002 

None of the nine stories from this year appeared in the portfolio. The majority of 
them repeat the debate over whether MPSAP should be abandoned and how it will be 
replaced. 

2003 

Eleven stories from this year referenced MSPAP. During the summer of 2003, 
several stories reported on how students performed on the new set of assessments (one 
story included in the portfolio). The remaining stories discussed the merits of the new 
assessment system (one story included). 
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Supplemental Search: Google 



A search was conducted for the time period of November 2003 to December 
2003, looking for the most recent consequences dolled out to educators and students in 
Maryland. Two of these stories are included in the portfolio. 

Supplemental Search: LexisNexis 

A search was conducted for the time period of December 2002 to December 2003, 
targeting consequences dolled out to schools, districts, students, teachers, and 
administrators based on student performance and over the immediately preceding year. 36 
A total of 3 1 stories resulted from this search, a selection of which is included in the 
portfolio. 

North Carolina 

An initial search using LexisNexis for stories in North Carolina on the 
accountability system was conducted for the time period 1990-1995. This period was 

TO 

chosen to cover the range of dates leading up to and including when the ABC 

TO 

assessment system began (1994). One of the first articles gleaned from this search was 
produced in 1994 and discusses the state’s fourth annual release of school report cards. A 
follow-up search based on this information and looking for any comment on school 
report cards prior to this time yielded no additional stories. Thus, it is possible that even 
though schools received a “report card” indicating how they were doing, prior to 1994, 
they were not publicly presented. A selection of stories based on this initial search for 
the 1990-1995 time period is included in the portfolio. 

1996-1999 
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Confining the search to this time frame yielded 471 stories. After redundant and 
irrelevant stories were discarded, a total of 57 of the most relevant stories were carefully 
reviewed. Of these, 14 are included in the portfolio, chosen to represent the range of 
themes during this period. During 1996 there were a few stories describing a proposal to 
offer rewards/incentive pay to teachers for student performance. Further, there were 
debates about the merits of giving (or striping) teachers of tenure based on student 
performance. During 1997, there was an increase in the number of stories as the ABC 
assessment plan had begun. There were stories describing student performance from the 
1995-1996 assessment and stories describing the ABC assessment system in general to 
the public. Further, there were stories about North Carolina adding higher stakes to their 
accountability measures — holding teachers, schools and students accountable for how 
they perform on standardized tests. In August 1997, there were numerous stories 
describing how schools across the state had performed on the most recent wave of 
statewide assessments. Throughout 1998, there continued to be stories recounting how 
schools and students had done on previous year’s standardized tests. One particular area 
(Guildford) was getting a lot of attention. A selection of stories from this time period is 
in the portfolio. 

2000-2002 

Confining the search to this time frame yielded 297 stories. After redundant and 
irrelevant stories were discarded, a total of 53 stories were chosen for a closer review. Of 
these, ten are included in the portfolio. They were chosen to represent the range of 
themes during this period. In general, stories ranged from general reporting (reporting 
how students in various districts did on statewide exams), to opinion-based editorial 
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either decrying or supporting the accountability system in North Carolina. During 2002, 
there were many stories describing the flaws of the statewide writing assessment and 
debates over whether and how to release the results. Further, journalists commented on 
the merits of a writing test with so many flaws. A selection of these stories from these 
years is included in the portfolio. 

2003 

Confining the search to this time frame yielded 104 stories. After redundant and 
irrelevant stories were discarded, a total of 17 of the most relevant stories were selected 
for careful review. Of these, five are included in the portfolio. At the beginning of the 
year, stories focused on the state legislature’s plan to pull back on testing demands made 
on students in the primary grades. School report cards were released in the Fall of 2003 
and numerous reports documented the plight of schools that were labeled “under 
performing.” 

Supplemental Search: Google 

A search was conducted on December 16, 2003, covering the previous 30 days, to 
look for any articles related to North Carolina’s accountability program. This search 
yielded stories that represented the most recent information on accountability at the time. 
Supplemental Search: LexisNexis 

A search using LexisNexis was conducted in an effort to find any stories from 
2003 that reported on any consequences being dolled out to students, schools, and/or 
teachers. A variety of search terms were used to include a wide range of possible 
consequences. A selection of these stories (which include both sanctions and rewards- 
based consequences) is included in the portfolio. 
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APPENDIX I: SUMMARY OF NEW SEARCH 



RATIONALE— FINALIZED SYSTEM 
Arkansas 

A review of the state department of education documents revealed some of the 
language used by Arkansas to denote the states’ accountability and assessment system. A 
variety of these terms were used to yield a large number of relevant stories from 
LexisNexis. 40 The first search using the search string [(assess! or test!) and (high-stakes 
or accountab!) and not (sport)] yielded more than 1,000 documents, forcing narrower 
search criteria. A second search using the string [(assess! or test!) and (high-stakes or 
accountab!) and (school or district or student or teacher) and not (sport)] also yielded 
more than 1,000 hits. The term “test!” was eliminated from the search string since often 
its inclusion added stories on “testimonies” (trial related). This search using the string 
[(assess!) and (high-stakes or accountab!) and (school) and (student or teacher) and not 
(sport)] yielded 427 stories that spanned January 16, 1985, through February 10, 2004. 

Twelve stories were eliminated outright since they appeared prior to 1990. Given 
that NAEP data was only first collected in 1990, stories prior to that time were irrelevant 
and therefore not included. A cursory review of the remaining stories led to the deletion 
of almost 300 stories due to redundancy or irrelevancy of the story contents. A total of 
68 stories were chosen for careful review, coding, and selection for inclusion in the 
portfolio. A breakdown of the number of stories reviewed based on year and major 
category is displayed in Table 1. 
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Table 1: Story Tallies By Year and Category for Arkansas 



Year 


Number of 
Stories 


Category* 


Number of 
Stories per 
Category 


1990 


1 


P 


1 


1991 


3 


R/L 


2/1 


1994 


1 


L 


1 


1996 


2 


R/L 


1/1 


1997 


4 


R/O 


2/2 


1998 


4 


R/L 


1/3 


1999 


9 


R/L 


6/3 


2000 


6 


R/O/PI 


4/1/1 


2001 


7 


R/L/O 


4/1/2 


2002 


10 


R/L 


5/5 


2003 


16 


R/L/O 


10/5/1 


2004 


2 


R 


2 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L= legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and PI=personal interest (these stories focus on specific individuals and their experiences in high-stakes 
environment). 



Content Analysis 

Thirty-seven stories were downloaded for careful review that had a “reporting” 
theme. Most recently, these stories contained information on policy information and 
updates as well as reports on student achievement. For example, in February 4, 2004, 
there was a story that reported on a list of 10 items that the state Supreme Court wanted 
the state to review to see if one school district was in compliance. Within this list was a 
summary of the accountability measures in the state. The article notes: 

Accountability and testing measures [should be] in place to evaluate the 
performance and rankings of Arkansas students by grade, including in-state, 
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regional and national rankings. The Legislature enacted Act 35 by Sen. Steve 
Bryles, D-Blytheville. It calls for more standardized testing, tracking of 
individual student progress from grade to grade, and a grading system of 
schools. 41 

Another article from November 1, 2003, reported on how students performance 
on the latest round of testing caused 219 schools to be labeled as “not improving.” The 
headline reads, “Low test scores put 219 schools on troubled list State now has 342 that 
must offer pupil transfers, tutoring.” 42 

Nineteen stories had a “legislative” theme. Some of the more recent stories of 
2003 with this theme included a report of the state Board of Education’s decisions about 
the contents of the new school accreditation rules: 

The board’s action on accreditation standards put the proposed new rules out for 
30 days of public comment. 

Currently, the state requires schools to offer all 38 courses that make up 
the core curriculum, but does not require them to be taught each year. 

Smart Core, the proposal that Simon has called "the answer to inefficient, 
ineffective high schools," could imperil some small schools that might have 
difficulty affording instructors to teach the core every year. Reducing the number 
of high schools to better enable the state to afford education reforms is a key 
element in Gov. Mike Huckabee's plan to address court-ordered public school 
improvements. 

The academic distress designation authorizes the state Department of 

Education to provide special assistance to districts to improve student 
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performance. It also triggers provisions of a new law authorizing the state board 
to act years sooner to address chronic academic or fiscal distress. If the percentage 
of students below math proficiency does not fall below 75 percent within two 
years, the state has a range of options, up to and including annexation or 
consolidation. 43 

This story includes some details of the accountability laws when schools are given an 
“academic distress” designation. 

Another “legislative” story appeared on September 7, 2003, in the Arkansas 
Democrat-Gazette (based in Little Rock), and reported on the ongoing legislative debates 
about how to impose standardized testing across the state. The story presents information 
on decisions made by the state Board of Education regarding the use of criterion- 
referenced tests for measuring academic progress — a measure that meets criticism from 
local businesses who prefer norm-referenced tests as a way of judging student 
performance in their local areas: 

The state Board of Education added to the dispute Aug. 1 1 by voting to reduce the 
state's use of a test that makes it possible to compare Arkansas students with a 
sample of students from other states. In testing circles, this is called a “norm- 
referenced” test. The board decided that, starting this school year, the test would 
be given only in grades five and nine. Previously, it also was used with students in 
grade 10. At the recommendation of Education Department Director Ray Simon, 
the board preferred the state's Benchmark Exam, which measures students' 
knowledge of subjects the state has said they should learn. This is called a 
"criterion-referenced" test. The board's rationale was that the state needs to 
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comply with the federal No Child Left Behind law's requirement that states test 
their students every year on the students' mastery of the state's curriculum. 

The Arkansas State Chamber of Commerce/Associated Industries of 
Arkansas and many business leaders who say using norm-referenced tests helps 
the state recruit business and industry to Arkansas criticized the board's decision. 
The board agreed to pay for school districts to give the norm-referenced tests in 
more than two grades, provided the Legislature appropriates more money for this 

44 

purpose. 

Lastly, there were very few opinion/reactionary oriented stories. In fact across the 
entire 13-year time span there were only six stories downloaded for careful review and 
consideration. Of these six, all of them were editorials commenting on the pros and/or 
cons of the state’s evolving accountability system. A selection of these editorials, 
representing both sides of the issue, are included in the portfolio. 

Supplemental Search: Google 

A search was conducted on February 20, 2004, covering the previous 30 days, that 
yielded about 40 stories — most of which were unrelated or repeated the same story of the 
new bill that was signed into law that stipulates the state’s accountability system. Two of 
these stories are included in the portfolio to outline this newly approved accountability 
program. 

Supplemental Search: LexisNexis 

Additional searches were conducted to look for consequence-oriented actions in 
the state of Arkansas that span the most recent time frame available. Across the previous 

year, LexisNexis 45 was used to look for stories that reported on specific actions taken to 
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reward or sanction schools, students, teachers, and/or administrators. There were 55 hits 



from this initial search. A review of the stories led to the elimination of several due to 
redundancy or irrelevancy, leaving eight stories — each of which was included in the 
portfolio. 

California 

The first search was conducted using a search string to yield the widest number of 
stories possible covering the LexisNexis universe of California news sources. 46 Several 
searches yielded more than 1,000 documents; therefore, adjustments in search string 
terms and time frames had to be made. The first search 47 yielding a manageable set of 
stories was confined to the time frame of January 1, 1990, through December 31, 1995, 
and yielded 238 stories. These were reviewed for content and 61 were downloaded for 
more careful review and content coding. 

A search confined to the next five year time span returned over 1,000 documents. 
Indeed, even confining the search to a year-by-year search produced anywhere from 300- 
900 stories. Thus, a more restrictive search string was used to make the task more 
manageable and to capture stories from 1996 through the present. By eliminating the 
word “test” from the search string, many stories were eliminated from consideration, 
thus making the review more manageable. A search looking over the time period of 
January 1, 1996, through December 31, 1999, using this new search string yielded 348 
stories. After redundant and irrelevant stories were removed, 69 were downloaded for 
consideration. 

Eliminating the word “test” from the 1996-1999 search string dramatically 
reduced the number of search “hits” to a more manageable number. However, for the 
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next search across the next time period, the term “test” was reintroduced into the search 



string. It seemed important to continue to see how vast the number of hits would be 
when broadening the search terms. The next search was confined to the time frame of 
January 1, 2000, through December 31, 2001. This search 49 yielded 358 hits, 70 were 
downloaded for careful review. Lastly, a search covering the most recent time span of 
January 1, 2002, through February 24, 2004, returned 495 hits of which 34 were 
downloaded for more careful review. 

Content Analysis 

A total of 234 stories were carefully reviewed for consideration to be included in 
the portfolio. A summary of these stories disaggregated by year and primary content 
theme is presented in Table 2. 
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Table 2: Story Tallies by Year and Category for California 



Year 


Number of 
Stories 


Category* 


Number of 
Stories per 
Category 


1990 


2 


R 


2 


1991 


3 


R/L/O 


1/1/1 


1992 


6 


R/L 


5/1 


1993 


15 


R/L/PI 


8/6/1 


1994 


20 


R/L/O 


11/5/4 


1995 


15 


R/L/O/PI 


9/3/1/2 


1996 


4 


R/L 


1/3 


1997 


21 


R/L/O/PI 


6/12/2/1 


1998 


23 


R/L/O 


12/5/6 


1999 


21 


R/O/PI 


16/3/2 


2000 


32 


R/L/O/PI 


18/3/7/4 


2001 


38 


R/L/O/PI 


27/3/6/2 


2002 


13 


R/L/O/PI 


9/ 1/2/1 


2003 


17 


R/L/O 


13/2/2 


2004 


4 


R 


4 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in high-stakes 
environment). 



A description of the primary themes of these stories based on time frame and primary 
content category is described next. 

1990-1995 

During this time frame there were 36 stories categorized with a “reporting” 
theme. As California’s assessment system developed, there were many stories discussing 
how students were doing on the CAP and how to address student weaknesses. For 
example, one headline stated: “Test scores dip for eighth-graders: Results of the state 
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CAP exams show a 4-point decline for county students from 1990. But San Jacinto 
Unified had a gain of 10.” 50 Many headlines and their stories reported on how students in 
the local area of news coverage did on the most recent round of California testing. Other 
“reporting” type stories debated the merits of educational reform. For example, one story 
talked about whether the CAP needed to change and another reported on the new 
statewide test that would replace the CAP. One article reported: 

Test taking for California students no longer means reams of multiple-choice 
questions and filling in tiny bubbles with No. 2 pencils. A new series of 
achievement tests, dubbed California Learning Assessment System, is making its 
debut in fourth-, eighth- and lOth-grade classrooms across the state this month, 
replacing the multiple choice - or multiple guess - type of exams that has been a 
rite of spring since the 1920s. 51 

During this time period, there were also a few legislative stories, documenting current 
voting patterns by the legislature. For example, in 1994, the legislature voted to approve 
the new testing system. 

Lastly, there was also a selection of editorial/opinion-oriented stories commenting 
largely on whether it was a good idea to base decisions on a single test score. One 
editorial writer argues: 

But written tests don’t tell the whole story. Before state officials start issuing 
grades, they should drop by a Modesto City Schools classroom where a dozen 
different languages are spoken. They should sail into Lou Winter’s classroom in 
Salida when he's passing out “Winter bucks” to give learning handicapped kids 
incentive to achieve. 
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Or, I have an idea. They should visit Mary Jane Tucker’s third-grade class 
at Stockard Coffee Elementary School in Modesto at 8:05 a.m. She'll be sitting at 
her desk, braiding the long wispy hair of a little girl whose mother is too sick with 

52 

cancer to do it herself. 

1996-1999 

During this time period, 35 stories were coded under the “reporting” theme. 
California was in a transitional period and therefore many of the “reporting” stories 
centered on keeping the public updated on California accountability policy. For example, 
one article discussed how charter schools would meet accountability provisions. Another 
reported on the financial awards given to a few local schools for making academic gains. 
By the end of this time period, there was a surge in “reporting stories” — stories that gave 
the public data on how students were doing on the new STAR test that had been 
implemented in 1998. 

In 1997, there were many legislative stories commenting on the proposals being 
made and argued with respect to the new assessment system. Lastly, there were a few 
editorial/opinion stories that centered on government control and arguing the merits of 
giving the state central control over schools. Many believed that local control is best; 
however, both sides were presented. 

2000-2001 

During this time period, there were many stories documenting school’s API 
rankings. These kinds of stories emerged in communities throughout California with 
some decrying the problems with API and others stating how well their schools are 

doing. There were also public debates on how to use API to close the achievement gap as 
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well as a few editorials lamenting the problems with hanging so much on a single test 



score. 

2002-February 2004 

The most recent sets of stories fit under the category of reporting — many stories 
were focused on most recent API calculations — and some communities celebrated 
improvements while others worried about potential state sanctions. A few stories argued 
against tests, claiming that students had to take too many tests — this viewpoint was 
expressed by students and parents. Other issues in the news concerned how to 
accommodate students with disabilities and students whose second language is English 
when they are forced to take tests. 

A selection of stories from each time period represented a cross section of the 
issues discussed above, and was included in the portfolio. 

Supplemental Search: Google 

A search was conducted on February 24, 2004, covering the previous 30 days. 

The few available were relevant to educational accountability. 

Supplemental Search: LexisNexis 

A search of stories from February 2003 through February 2004 was conducted 
looking for specific articles on consequences dolled out to students and/or school 
personnel in the form of rewards (incentives, bonuses) and sanctions (retention, school 
takeover). The first search provided over 1,000 documents 53 , so searches were 
disaggregated into two categories based on type of consequence (reward versus sanction). 
The first of these two searches again eliminated the word “test” from the search string 

and only looked for rewards. 54 This search yielded 53 hits, six of which were 
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downloaded for more careful review. A second search looked for sanction-oriented 



stories. This search 55 returned 121 stories, of which 44 were downloaded for more 
careful review. A selection of stories representing the major issues from these two 
searches was included. 

Connecticut 

A search was conducted across the entire LexisNexis universe of news media 
available in Connecticut. 56 This search 57 yielded 133 stories, of which 48 were reviewed 
more carefully for possible portfolio inclusion. Interestingly, in spite of knowing that 
Connecticut had instituted a statewide exam as far back as 1985, none of the stories 
emanating from this original search yielded stories before 1998. Therefore, a second set 
of searches was conducted specifically confined to the time period prior to 1998 to see if 
there was any coverage of assessment and accountability in the state. A search of 
Connecticut Mastry Test (CMT) yielded no additional stories prior to 1998. 

Additionally, a search of CMT provided only a few stories that were primarily radio spots 
announcing the test’s schedule. Still, these only dated back to 1992. Thus, there did not 
seem to be much coverage of student testing prior to 1998 in Connecticut as far as the 
sources available to LexisNexis reveal. 

Content Analysis 

The number of stories that were reviewed based on year and primary content are 
presented in Table 3. A total of 48 stories were considered carefully for inclusion in the 
portfolio. A description of the primary themes of these stories across time is described 
next. 
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Table 3: Story Tallies by Year and Category for Connecticut 



Year 


Number of 
Stories 


Category* 


Number of 
Stories per 
Category 


1998 


3 


R 


3 


1999 


4 


R/PI 


3/1 


2000 


2 


R 


2 


2001 


1 


R 


1 


2002 


6 


R/L 


5/1 


2003 


24 


R/L/O/PI 


19/1/3/1 


2004 


8 


R/L/PI 


6/1/1 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



1998-2002 

There was little coverage of the CMT and Connecticut Academic Performance 
Test (CAPT) examinations during this time frame. Of the stories considered for 
inclusion, most of them centered on students’ test results. These reports can be further 
divided into two major categories — those that report on local students and those that 
report on state-level trends. An example of a localized report from 1999 came from 
Bridgeport, CT: 

The city's schools are ushering in the New Year with positive tidings. 

The latest Connecticut Academic Performance Test scores show this year's 
crop of lOth-graders outscored previous ones. 
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Milford's lOth-graders also outperformed other communities in the city's 



economic reference group and ranked ahead of the state average. The state 

co 

Department of Education released the results Monday. 

Some stories also commented on statewide results. For example, in 1999 one 
article talked about the mixed successes of students on the most recent CAPT testing: 

Statewide scores on the Connecticut Academic Performance Test have changed 
little, although there were small improvements in math and the interdisciplinary 
section of the test. Results released Monday indicate while there were some 
improvements in two sections of the test, the percentage of lOth-graders meeting 
goals in science and language arts dipped slightly. "As a state we probably haven't 
made as much progress as we would have liked, but we know were moving in the 
right direction," state Education Commissioner Theodore Sergi said. 59 

There were also policy-oriented stories such as the one appearing in 1999 
discussing the pros and cons of abandoning the practice of social promotion. This issue 
was prevalent in Hartford: 

City school officials will move ahead with plans to end social promotion of 
students, but they will move a bit slower than first expected. For the first time, 
city students could repeat a grade for having low scores on the Connecticut 
Mastery Tests, however the standards are far looser than new Superintendent 
Anthony S. Amato had indicated in recent weeks. The state policy that 
discourages promoting failing students just so they can keep up with their age 
group does not take effect until the next school year. 60 
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2003-2004 



During these two years, more stories emerged discussing the merits of No Child 
Left Behind and students’ progress toward meeting state and federally defined academic 
goals. For example, in 2003, several local news reports show how students performed on 
the most recent CAPT testing. Many schools were seeing improvements, while a 
selection of schools continued to face disappointing test results. By far, the largest 
number of stories were “reporting” how students did on the most recent round of testing. 

The most recent selection of stories from 2004 discussed the state’s problems with 
the testing company that was in charge of grading the CMT. Indeed, CMT scores were 
delayed because of large errors in scoring amassed by the testing company. 
Supplemental Search: Google 

A search was conducted on March 3, 2004, covering the previous 30 days. 

Several search terms were used to probe for the widest selection of stories. 

Supplemental Search: LexisNexis 

A search confined to the immediately preceding year (March 2003-March 2004) 
was conducted looking for specific articles on consequences dolled out to students and/or 
school personnel in the form of rewards (incentives, bonuses) and sanctions (retention, 
school takeover). The search returned 16 stories, 61 only two of which were relevant and 
not redundant from the previous searches. 

Georgia 

A search was conducted across the entire LexisNexis universe of news media 

available in Georgia. 62 This search 63 yielded over 1,000 stories. Therefore, subsequent 

searches 64 confined to shorter timelines were conducted in an attempt to reduce the 
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number of stories to review. The first search across January 1, 1990, through December 
31, 1996, yielded 250 stories, of which 41 were downloaded for more careful review. A 
second search was conducted across a second time frame of January 1, 1997, through 
December 31, 2001. However, it still yielded too many stories to review (more than 
1,000). Therefore, a different search string was used to reduce this larger pool down to a 
more manageable set of stories. Using a slightly altered search string [(assess!) and 
(accountab!) and (school or student or teacher) and not (sport or court)] still yielded 
upwards of 900 stories; therefore, the search string was altered again in another attempt 
to limit the number of stories. This final search string [(test!) and (accountab!) and (high 
stakes) and (school or student or teacher) and not (sport or court)] and covering the 
period of January 1, 1997, through the present yielded a dramatically fewer number of 
stories (94) all of which were downloaded for careful review. 65 

In spite of the dramatically reduced number of stories found by limiting the search 
string, it was reasoned that the resultant selection of stories would represent the most 
relevant aspects of accountability in the state. Thus, although there were fewer stories to 
review, the content of these stories probably accounted for a reasonably representative 
range of issues that would have been found across a broader range of news coverage. 
Additionally, by reducing the overall number to 94 versus 200 or 300, it allowed for a 
more careful review and analysis. 

Content Analysis 

The number of stories that were reviewed based on year and primary content are 
presented in Table 4. A description of the primary themes of these stories across time is 
described next. 
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Table 4: S 


tory Tallies by Year and Category for Georgia 




Number 
of Stories 




Number of 


Year 


Category* 


Stories per 
Category 


1991 


2 


L/O 


1/1 


1992 


3 


R/O 


2/1 


1993 


2 


R/L 


1/1 


1994 


1 


O 


1 


1995 


13 


R/L/O 


6/4/3 


1996 


9 


R/L/O 


5/3/1 


1997 


2 


R/L 


1/1 


1998 


6 


R 


6 


1999 


23 


R/L/O/PI 


15/3/4/1 


2000 


12 


R/L/O 


8/1/3 


2001 


8 


R/L/O 


4/1/3 


2002 


9 


R/L/O/PI 


2/2Z3/2 


2003 


6 


R/O 


5/1 


2004 


2 


R 


2 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L= legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



1991-1996 

During this time there were several legislative events related to educational 
policy. For example, in the early 1990s, there were stories recounting the debates around 
testing and accountability. In 1991, one local community voted to reduce the testing 
schedule as evidenced in the headline: “The Gwinnett school system has reduced the 
number of standardized tests students must take; a move educators say will provide an 
extra 12 to 15 hours a year for teaching.” Other news stories presented debates around 
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proposed accountability system. For example, in the spring of 1995 lawmakers debated 
whether to scale back on the assessment and accountability system — opponents arguing 
that students endured too much testing and that the pressures were not worth it, and 
proponents arguing students and teachers should be held accountable and that tests were a 
critical component of monitoring them. A March 18, 1995 story sums up the major 
issues and subsequent vote: 

Georgia’s controversial school accountability tests will continue unchanged for 
another year, with students slated to take them this May and again in May 1996, 
the Legislature decided Friday after much wrangling. 

But principals, curriculum directors and other school administrators hired 
after this spring will not get permanent job guarantees that have been standard- 
issue for two decades - a decision that business leaders said will prompt a needed 
shake-up in the way some Georgia schools are run. 

Testing and tenure both went down to the wire. After a series of House- 
Senate stalemates, state Superintendent Linda Schrenko OK’d a compromise that 
spared the tests in order to assure that school administrators could readily be 
demoted. 

Once the deal was sealed, the Senate voted unanimously to end tenure for 
administrators, and the House followed, 95-67. 

But Shrenko pledged to revisit the tests in time to seek a change in the law 
next year and revise testing for the 1996-97 school year. State-mandated tests 
must provide more helpful feedback to teachers and parents, she said. 
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The Curriculum-Based Assessments, or CBAs, have been given since 
1992 to measure how well Georgia schools teach reading, math, science and 
social studies. They ended up on the chopping block late in the session. 

Schrenko and one of the state’s two major teacher groups said the CBAs 
should be scrapped because they don’t yield results for individual students or 
classrooms in most cases - only for entire schools - and they cost more than 
commercial national tests. 

But the state school board and the other major teacher group said ending 
the CBAs might lower educational standards. They urged a one-year delay until 
complicated questions could be resolved - and they won. 

School boards and the Georgia Chamber of Commerce cheered the end of 
tenure for administrators. 

“The passage of this bill is the most significant reform, apart from 
funding, passed since the Quality Basic Education Act” in 1985, said chamber 
President Charlie Harman. “It gives elected school boards and their appointed 
superintendents the right to assemble their own team.” 

But educators groups said allowing administrators to be demoted without 
hearings to show they deserve it could create civil rights violations and won’t 
solve the state’s education woes. 66 

During this time period, there were also many opinion pieces that wrangled with 
issues of accountability. In 1996, one editorial writer discussed the complexities of school 
reform in Georgia arguing that the testing system had to be overhauled. 
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A sound educational testing program achieves three goals: evaluation of student 
performance, feedback on curriculum and instruction and appraisal of teacher 
competency. Georgia’s student testing program does not measure up. It needs to 
be revised. 

The state tests too much in some grades, not enough in others, and fails to 
glean the most helpful data from the time devoted to testing, according to a 
student assessment report by the state Council for School Performance. 67 

Lastly, a few “reporting” stories described various state policies as well as 
performance results of students on latest rounds of testing. For example, in 1996, reports 
emerged on grades schools were assigned based on how well they were doing in reaching 
academic performance goals. One headline read: “Schools Graded B And C: State 
Report Finds Areas That Need Improvement In Richmond And Columbia Counties’ 
Systems.” 68 
1997-2004 

There were several prominent reporting themes that emerged during this time 
frame. First, from 1997 to 1999, there were several stories best characterized as 
“reporting” that presented both political issues and debates (R/p) as well as recent 
performance results (R/s). Policy debates during this time period included the pros and 
cons of the new state assessment system, local decisions to end social promotion, and a 
discussion of the policy of forcing students to pass an exit exam to receive a diploma. 
Several articles reported on how students performed on recent exams. For example, in 
1998 a report indicated that high schoolers who took a practice version of the science 
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portion of the exit exam failed. One headline read: “Exit exam cuts graduation rate: 

New science portion squeezes out some.” 69 

Throughout 1999 there were several stories on one large school district’s 
achievement and debates around social promotion. Gwinnett County School District was 
the first district in the state to end social promotion for third graders and many articles 
appeared discussing the problems and concerns with such a policy — both there and for 
Atlanta area schools. For example, the following story appeared on October 9, 1999: 

The Gateway is Gwinnett educators’ version of a “high stakes test” — a type of 
standardized test students must pass before moving on to the next grade. Such 
tests are gaining popularity nationwide as a response to the increasing demand for 
greater academic standards and accountability. In administering the Gateway, the 
Gwinnett district — Georgia’s largest with about 104,000 students — becomes 
the first in the state to use a high stakes test. 

Starting this school year, Christine’s academic fate and that of thousands 
of other Gwinnett County public school students will hinge on a single factor: 
whether they pass the Gateway test. 

County school officials will require all fourth-, seventh- and lOth-grade 
students take the exam in April in an attempt to raise the academic bar. 

Critics of high stakes tests question whether the tests, including Gateway, 
are the best way to gauge student learning. Among their concerns: Is the exam too 
tough for students? Can teachers cover all the material on the test before it’s 
administered each year? Should it be the sole criterion for promotion and 
graduation? Does it truly result in better teaching and learning? 

Page 215 of 336 

This document is available on the Education Policy Studies Laboratory website at: 

http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0509-105-EPRU.pdf 





After three years of research and development of the Gateway, Gwinnett 



County officials think they’ve answered those questions. 

They say the test is needed to end social promotion — the practice of 
moving students to a higher grade even if they haven’t mastered the material — 
and to ensure against grade inflation — when teachers boost student grades even 
if they haven’t earned it. County school officials also say that the test will stress to 

70 

teachers and students the importance of mastering class work. 

The most recent round of stories (2000-2004) focused on the evolution of 
Georgia’s accountability system and include a cross section of reporting (on statewide 
tests, school labels), legislative (e.g., passing legislation to end social promotion for third 
graders in 2001), and opinion (writers expressing mostly concern and resistance to the 
use of tests as a measure of students, teachers, and schools). 

Supplemental Search: Google 

A search was conducted on March 12, 2004, covering the previous 30 days. 
Several search terms were used to probe for the widest selection of stories. A selection of 
the resultant stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A search confined to the immediately preceding year (March 2003 -March 2004) 
was conducted looking for specific articles on consequences dolled out to students and/or 
school personnel in the form of rewards (incentives, bonuses) and sanctions (retention, 
school takeover). This search returned 294 stories, of which 29 were downloaded for 
review. A selection of these stories was included in the portfolio. 
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Hawaii 



72 

A search “ was conducted across the entire LexisNexis universe of news media 

no 

available in Hawaii. This search yielded 49 stories dating back to 1998, of which 19 
were reviewed more carefully for possible portfolio inclusion. 

Content Analysis 

The number of stories that were reviewed based on year and primary content are 
presented in Table 5. There were a total of 19 stories that were considered carefully for 
inclusion in the portfolio. A description of the primary themes of these stories across 
time is described next. 



Table 5: Story Tallies by Year and Category for Hawaii 



Year 


Number of 
Stories 


Category* 


Number of Stories 
per Category 


1998 


1 


R 


1 


1999 


4 


R/L 


3/1 


2000 


4 


R/L 


1/3 


2001 


2 


R 


2 


2002 


3 


R 


3 


2003 


3 


R 


3 


2004 


2 


R 


2 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L= legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and PI=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



1998-2004 

Between 1998 and 2004, the primary themes embedded in the stories available for 
Hawaii were of a “reporting” nature. Indeed, most stories reported on the legislative 
debates around financial and accountability proposals. Most stories presented legislators’ 
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positions on particular issues without reporting the specifics of the issues being debated. 
For example, in 1999, the state superintendent of education was quoted on his position on 
educational accountability. The article notes: 

Accountability will be the cornerstone of schools superintendent's plan to upgrade 
the education system. Paul LaMahieu said accountability is just one piece of the 
overall picture, which includes assessment and standards, aimed at raising student 
achievement. At a Tuesday night forum sponsored by the Education Commission 
of the States with the Department of Education, LaMahieu said the plan presents a 
measurable opportunity. 

“I'm excited because we have the opportunity to build something that can 
measure up,” he said. 74 

The issue of how accountability would be incorporated into the state system was unclear. 
The article goes on: 

LaMahieu said designing a testing and accountability system linked to the 
standards will be done simultaneously. He also said accountability should not be 
solely punitive, but should include rewards and assistance for those who need it. 

“Make it challenging, make it demanding, and make it possible for us all 
to succeed,” he said. 75 

More recent articles had similar perspectives. That is, legislators were quoted and 

issues were debated, but specifics on how accountability would be implemented were not 

provided. The most recent article found in 2004 discussed what measures would be up 

for a vote in November, but again, it is not clear what the specific nature of these issues 

are or where the state’s constituency stands on it. Part of the issue is that the state is in a 
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transitional period where many issues are being debated, but will not be clearly defined 
until it is put to a vote. In this article, some of the issues are raised: 

Gov. Linda Lingle has made it her mantra on the issue of education reform: Let 
the people decide. But decide what? Seven local school boards or 17 elected 
members of the state Board of Education? Veto power or voting power? 
Autonomy? 

By the end of the week, Hawaii voters should have some idea of what 
measure - or measures - they will get to decide next fall as lawmakers go about 
trying to reform the state's oft-criticized public education system. The choice may 
not be as simple as just choosing whether to set up seven locally elected school 
boards, Lingle proposes. 

Lawmakers considered as many as five constitutional amendments related 
to education that they conceivably could ask voters to decide in November. 
Putting all five measures on the ballot is not likely, but lawmakers say they want 
to give themselves ample time to study all possible ways of raising student 
achievement in the public schools. 76 

Many of the stories are included in the portfolio to represent the range of issues being 
debated over time. 

Supplemental Search: Google 

A search was conducted on March 3, 2004, covering the previous 30 days. 

Several search terms were used to probe for the widest selection of stories. A search 
using just the term “assessment” yielded 60 stories, of which only two were relevant and 
are included in the portfolio. 
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Supplemental Search: LexisNexis 

A search confined to the immediately preceding year was conducted looking for 
specific articles on consequences dolled out to students and/or school personnel in the 
form of rewards (incentives, bonuses) and sanctions (retention, school takeover). The 
search provided 12 stories, of which none were relevant. Follow-up searches were 
conducted looking more pointedly for rewards and sanctions throughout the state and 
based on the previous year. The first search, using the string (assess* or test*) and 
teacher (reward or bonus or incentive), yielded no stories. A second search using the 
string (assess* or test*) and school award, returned no stories. A few searches looking 
for sanctions were subsequently conducted. The first, using the string (assess* or test*) 
and school closure, yielded no stories. Similarly, a second search, using the search string: 
(assess* or test*) and school reform, also provided no stories. Another two searches, 
using the search strings (assess* or test*) and fire, and (assess* or test*) and school 
takeover, also yielded no stories. A final attempt was made looking for stories on 
consequences to students. A search, using the search string: (assess* or test*) and student 
(promotion or retention or scholarship or graduation), yielded two stories — both of which 
are included in the portfolio. Importantly, these are the only two stories from this search 
included in the portfolio. 

Kentucky 

70 

A search was conducted across the entire LexisNexis universe of news media 
available in Kentucky. This search yielded over 157 stories spanning from 1997 
through the present. Redundant and irrelevant stories were eliminated (some news 
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coverage extended to other states such as North Carolina), leaving 50 stories that were 



downloaded for closer review. 

Content Analysis 

The number of stories that were reviewed based on year and primary content are 
presented in Table 6. A description of the primary themes of these stories across time is 
described next. 



Table 6: Story Tallies by Year and Category for Kentucky 



Year 


Number of 
Stories 


Category* 


Number of Stories 
per Category 


1997 


1 


PI 


1 


1998 


5 


R/PI 


4/1 


1999 


5 


R/L 


4/1 


2000 


10 


R/L/PI 


8/1/1 


2001 


5 


R/L 


4/1 


2002 


10 


R/L/O 


8/1/1 


2003 


13 


R/L/PI 


7/5/1 


2004 


1 


L 


1 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



Kentucky’s state standards were adopted in 1996 and revised in 1999. An 

accountability system based on measuring progress toward these standards was not in 

place until the late 1990s. Therefore, it is not surprising that stories on high-stakes testing 

did not emerge until 1997. Although Kentucky had adopted some form of rewards and 

sanctions dating back at least as far as 1993, substantial news coverage of this type of 

accountability did not emerge again until 1997. Story selection for the portfolio is based 
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on how accountability and assessment, legislative proposals, adoptions, and 
implementation were covered from 1997 through the present. 

From 1997 through 1998, there was little coverage on Kentucky’s statewide 
testing and accountability system (at least as defined by what is covered on LexisNexis 
and using the search string previously defined). During that time the new accountability 
system was being introduced and school-level testing results were revealed. One October 
1998 story written by the Associated Press summarized the current accountability issues: 

The state’s philosophy about accountability for public schools has shifted - 
significantly, some say. 

Since an education reform movement began in 1990, the Kentucky Board 
of Education has required schools to be judged by whether their students mastered 
the subjects deemed necessary in meeting high academic standards. 

How students individually compared with one another, or with students in 
other states, was not paramount. Besides other states did not have high-stakes 
accountability like Kentucky, with cash rewards for success and sanctions for 
failure. 

Individual comparisons still are not paramount, board members said 
Tuesday. But they decided that schools’ overall accountability ratings should 
include, in small part, scores of standardized tests designed to show how 

on 

individual students stack up against their peers. 

Interestingly, Kentucky’s initial accountability system was defined by how students 

mastered subjects. However, in 1998, the state board of education adopted a new set of 

norm-referenced tests to hold students and schools accountable. This change yielded 
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confusion in how schools were subsequently labeled — and therefore affecting rewards 



and sanctions. In December of 1998, it was reported: 

The numbers say 58 Kentucky schools declined drastically in two years. 
Education Commissioner Bill Cody said he does not necessarily believe it. 

“I don’t think the classifications were very sound,” Cody said as the latest 
round of public school test scores became public Thursday. 

Nine schools were classified “in crisis” in 1996, the end of the previous 
testing cycle of Kentucky’s system for assessing student progress and holding 
schools accountable for the results. 

The sudden increase to 58 “is an artifact of a flawed accountability 
formula,” Cody said. “I don’t think that number 58 represents a fact that there are 
58 schools in crisis.” 

Schools are no longer labeled “in crisis.” They now are classified as 
“decline/parent notification,” meaning parents can have their children sent 
elsewhere. The effect is the same. Some schools’ classifications have always 
seemed anomalous. 

A school can be among the highest scoring in the state, yet be in decline 
because it competes against its own past performance, not against other schools. 81 

By 1999, a new accountability system was adopted: 

The Kentucky Board of Education is poised to give schools - literally - a graphic 
illustration. 
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Under a plan that could be approved today, every public school in 
Kentucky would have a common target to shoot for and the same deadline for 
hitting it. 

A school’s progress could be plotted on a graph. There would be a starting 
point, an ending point and a straight line connecting them. A school’s 
performance, ideally, would follow that “line of expected growth.” 

That is the essence of a 14-year measuring rod - a model for tracking 
school improvement, or lack of it, from 2000 through 2014. The new 
Commonwealth Accountability Testing System - CATS - was mandated by the 
1998 General Assembly. 82 

Through 2000 and up to the present, stories mostly reported on current policy 
debates (R/p) and student performance levels (R/s). For example, throughout 2000, there 
was a series of stories describing how the state was going about the adoption of the new, 
and more rigorous, state performance standards. And, as the new state testing system 
was put into place to measure these standards (and appearing through 2000 and 2001), 
stories documented how students performed with the state releasing third graders’ CATS 
scores and fourth graders’ writing scores (among others). 

By 2002 and 2003, many stories were dedicated to the debates around how 
Kentucky’s accountability system, already in progress, would adapt to No Child Left 
Behind (NCLB) mandates. Some, it was reported, were especially critical of NCLB 
demands and fought to waive many of their requirements. Other stories described which 
schools had “failed” to make adequate yearly progress (AYP) under NCLB. For 
example, in September of 2002, one headline reported, “Kentucky Registers 28 Public 
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OT 

Schools on Federal ‘Failing’ List.” Schools that failed to make AYP were listed in this 
article. Similarly, legislative concerns were reviewed — including how Kentucky would 
introduce more testing to comply with NCLB (an issue met with concern and criticism 
later in the press). 

A cross section of the primary themes, issues, and trends in Kentucky are 
represented in the selection of stories included in the portfolio. 

Supplemental Search: Google 

A search was conducted on March 16, 2004, covering the previous 30 days. 
Several search terms were used to probe for the widest selection of stories. A selection of 
these stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A supplemental search 84 was conducted seeking out stories specifically 
addressing consequences to schools, districts, teachers, and/or students. This search was 
conducted over the previous year and returned 47 stories, most were irrelevant. Also, 
many of these stories simply repeated the themes that are included in the main thematic 
analysis. Still, three stories were included in the portfolio that discussed three issues 
relevant to the effects of sanctions and rewards in the state of Kentucky. 

Louisiana 

oc 

A search was conducted across the entire LexisNexis universe of news media 
available in Louisiana for the time period of January 1, 1990, through December 31, 

1999, using a search string including the acronyms Louisiana Educational Assessment 
Program (LEAP) and Graduation Exit Examination (GEE). 86 This search yielded over 

200 stories of which 57 were downloaded for review. A second search was conducted for 
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the time period of January 1, 2000, to February 12, 2004, using the same search string; 



however this yielded more than 1,000 documents. Therefore, subsequent searches 
confined to shorter time periods were conducted in an attempt to reduce the number of 
stories to review. 

The first follow-up search used a different search string and was confined to 
only the most prominent Louisiana Newspaper (The Times-Picayune) and covering the 
time period of January 1, 2000, through December 31, 2002. This search yielded 398 
stories, of which 102 were downloaded. A second follow-up search was conducted 
across the time frame of January 1, 2003 through March 13, 2004, yielding 194 stories, of 
which 65 were downloaded for review. 

Content Analysis 

The number of stories that were reviewed based on year and primary content are 
presented in Table 7. A description of the primary themes of these stories across time is 
described next. 
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Table 7: Story Tallies by Year and Category for Louisiana 



Year 


Number of 
Stories 


Category* 


Number of Stories 
per Category 


1994 


1 


R 


1 


1995 


0 


None 


0 


1996 


2 


R/L 


1/1 


1997 


10 


R/L 


5/5 


1998 


4 


R/L/PI 


2/1/1 


1999 


40 


R/L/ O/PI 


26/8/3/2 (+1 misc.) 


2000 


57 


R/L/ O/PI 


30/16/5/6 


2001 


25 


R/O/PI 


19/3/3 


2002 


19 


R/L/O/PI 


14/1/2/2 


2003 


56 


R/L/O/PI 


30/10/13/2 (+1 misc) 


2004 


9 


R/L/O/PI 


6/1/1/1 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and PI=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



1990-1999 

Although the search during this time frame included 1990-1993, stories 
containing the terms LEAP or GEE did not first appear until 1994. Between 1994 and 
1999, a large majority of stories were “reporting” in nature. Of these, many included 
“policy” related discussions (R/p) that described the ongoing issues, events, and debates 
around the state’s accountability system. For example, in 1996 a July article discussed 
the plight of several schools targeted for school improvement: 

Ten of Louisiana's worst schools will be targeted this fall for intensive 

improvement in a test run of the state's planned school accountability program. 

The schools will be chosen by the Department of Education based on standardized 
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test scores, tempered by "uncontrollable variables" such as poverty. The schools 
will be asked to write or revive improvement plans, and the department will offer 

oo 

training or other help to implement them. 

Similarly, in an article in March of 1999, a news writer described how the upcoming and 
new testing system adopted by the state was affecting students. The writer also described 
for readers what the new assessment system was and how it was going to be implemented 
and used: 

Children in grades 3, 5 and 7 will take the Iowa Test of Basic Skills. Children in 
fourth and eighth grades will take a revised version of the Louisiana Educational 
Assessment Program, called LEAP 21. The LEAP 21 will count for 60 percent of 
a school's rating on a scale created by the state Board of Elementary and 
Secondary Education. The Iowa test is weighted 30 percent. Attendance will 
make up 10 percent of the rating for kindergarten through sixth grade. For grades 
7 through 12, attendance is worth 5 percent and the dropout rate is worth 5 
percent. The state board will use this year's results to set goals for schools. 
Schools that exceed their goals every two years will be rewarded with praise and 
extra money. A school "in decline," one with a flat or falling score, will face 
increased oversight and direction from Baton Rouge. It's all part of Louisiana's 
school accountability program, and it has educators alternately anxious and 
excited. 89 

Another prominent type of story appearing during this time frame was 

“legislative” in theme. Within this category stories were further differentiated into “legal 

concerns and debates (L/l) and “voting/decisions” (L/v). Many stories emanating from 
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1996 - 1998 described the ongoing debates among state school board members in 
adopting a new accountability program. For example, in December 1997 it was revealed 
that one school board member found a flaw in the new accountability system. This 
article brings to light some of the issues the state school board was wrangling with in 
creating a fair accountability system: 

A member of the state's top school board unveiled statistics Thursday that she said 
demonstrate a major flaw in the new school accountability effort. Board of 
Elementary and Secondary Education member Donna Contois said she found a 
major problem with requiring school districts to identify the 20 percent of their 
schools that perform the worst. Contois said she favors the state's accountability 
effort, but added it's unfair to wrongly label schools in high-achieving districts as 
being low performing when they really aren't. By the same token, Contois said, it 
isn't a good idea to limit some poorer-performing districts to naming and helping 
only 20 percent of their schools if more need assistance. 90 

Another example of this sort of coverage came in 1998 when an article appeared 
describing the debates around creating a passing cut-off score on the LEAP: 

Plans for new “high-stakes” tests for Louisiana’s public school students, with 
harsh consequences for poor results, could be unpopular with the public, state 
education officials said Tuesday. But members of the Board of Elementary and 
Secondary Education haven’t decided what the stakes will be. The Legislature 
passed a bill last year requiring public schools to give fourth- and eighth-graders 
standardized tests beginning in the spring of 2000 that will determine whether 
students can move to the next grade. At a BESE committee meeting Tuesday, 
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members questioned the state education department’s recommendations on how 
to treat the test results. Possible scores on the test, called “LEAP for the 21st 
Century,” are: “unsatisfactory,” “approaching basic,” “basic,” “proficient” and 
“advanced.” 91 

In 1999, a large number of stories appeared from our search as it was a significant 
year in Louisiana’s accountability evolution. There were several stories that fit into the 
Legislative/voting category that described the decisions of the state board of education 
regarding cut off scores, accountability decisions, and labeling systems. There were 
many “reporting” stories that described how the state debated the LEAP. Lor example, in 
Lebruary of 1999, it was reported that the LEAP had been revamped to make it more 
difficult. The article reported on this legislative change and presented debates on it: 

LEAP 21, as the revamped Louisiana Educational Assessment Program has been 
dubbed by education officials, will require students to work through a more 
complicated, higher-order thinking process to arrive at correct answers. Lor 
example, students might be asked to find a number that is even and a multiple of 
both five and seven, given options such as 35, 49, 50 and 70. Eighth-graders also 
can expect to confront difficult questions along the lines of “Davey wears a shoe 
that is 6 inches long. By carefully putting one foot in front of the other, he can 
measure a room. How many steps will Davey take to measure the length of a 
room that is 24 feet long?” 

Some parents voiced concern that consistent grading of such a test will be 
difficult. Contois said graders will be trained to identify the required components 
of essay answers. The tests were developed by experts in each subject and have 
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been assessed for validity and reliability. Parents also expressed interest in 
developing programs for young students to address individual needs and better 
prepare them for the tests, and also for those who fail the LEAP exam more than 
once but might succeed in alternative learning environments. Educators said the 
new tests, and the accountability program as a whole, has been designed to meet 
the needs of both groups of students. 92 

Later in the year, several reports emerged documenting student performance on the latest 
Iowa Test of Basic Skills (ITBS) and LEAP tests. One story reported on the successes of 
a local school: 

West Feliciana Parish students did well on the nationally standardized tests given 
in Louisiana earlier this year, and the parish’s third-graders just missed leading 
the entire state, according to figures released last month. Only St. Tammany 
Parish - by one percentage point - topped West Feliciana’s third-graders on the 
Iowa Tests of Basic Skills, an achievement test used to compare student 
performance locally with that of students tested in a national sample. 

Others didn’t do as well: 

At least one fourth- or eighth-grader at every New Orleans public school, 
including the magnet schools, failed a critical portion of a statewide standardized 
test they took in the spring, according to school-by-school test results released 
Wednesday. 94 

There were a large number of stories covering the issue of social promotion and 
summer school. Students in Louisiana in grades 4 and 8 have to pass LEAP in order to 
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be promoted. 1999 was the last year before this policy was to go into effect. How 
students performed on this year’s tests indicated what schools/districts had to look 
forward to in subsequent years when the policy goes into effect. Some schools instituted 
a volunteer, but highly recommended summer school program to prepare students for 
next year’s test: 

A five-week session of summer school ended Friday for 7,354 Orleans Parish 
fourth- and eighth- graders who will be taking the new statewide "high- stakes" 
tests next spring. If the children fail the math or English section of the Louisiana 
Educational Assessment Program test, they will not be automatically promoted to 
the next grade. 

Based on predictions that 60 to 80 percent of children could fail the test, 
the district made free summer-school classes available to all rising fourth- and 
eighth-graders, not just those who needed remedial courses. Sixty-nine percent of 
the district's fourth-graders and 63 percent of the eighth-graders attended, said 
Gertrude Ivory, interim director of summer school. 95 

2000-2002 

The primary events and themes from 2000-2002 centered on how the 
accountability system evolved in Louisiana — i.e., in terms of state law as well as how the 
state planned to comply with the newly adopted NCLB act. Most reporting activities 
during this time period occurred in 2000 during which several main events happened. 
First, there were vehement debates in the press over the policy to end social promotion. 
Parents had formed a group to protest the policy of holding students back based on test 
scores. On January 13, 2000 it was reported: 
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A group of parents of public school students are organizing to stop the state 
Department of Education from failing fourth- and eighth-grade students who 
cannot pass a portion of the Louisiana Educational Assessment Program test. 

The group, calling itself Parents for Educational Justice, will meet tonight 
at 6 at St. Mark's United Methodist Church, 1130 N. Rampart St. 

C.C. Campbell-Rock and her husband, Raymond Rock III, formed the 
group after seeing the toll that intensive LEAP tutoring was taking on their 
daughter. 

Although the fourth-grader gets A's and B's at Dibert Elementary School 
in New Orleans, she worries about failing the test in March and being held back 
from fifth grade, Campbell-Rock said. Her daughter also worries that some of her 
friends would transfer to private schools if they failed the LEAP test, she said. 

Rock said she wonders how students held back because of LEAP will 
regain academic motivation or momentum. 96 

Subsequently, a flurry of stories emerged that reflected the public debate over the 
pros and cons of ending social promotion, culminating in local school boards adopting 
their own policies around social promotion. For example. New Orleans school district 
voted that students should not be held back because of performance on LEAP because 
they had not been adequately prepared: 

In a resolution passed 4-3 Monday night, the School Board said that students have 
not been adequately prepared for the exam and that it should not be used as the 

07 

main criteria for determining promotion. 
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However, in spite of the local vote, state department of education officials refused to 



bend: 

State Superintendent of Education Cecil Picard said he was "disappointed" that 
the state's largest school system followed the New Orleans City Council in taking 
a symbolic stance against the Louisiana Educational Assessment Program test. 
And he said he doubted the state Board of Elementary and Secondary Education 

go 

would change the exam's intent. 

A similar policy was confirmed in December 2000 for eighth graders: 

The state Board of Elementary and Secondary Education on Tuesday made more 
tweaks to the evolving eighth-grade testing policy, making it marginally easier for 
students who fail the LEAP test to advance to high school. 

The changes were endorsed unanimously in committee Tuesday and are 
expected to receive final approval Thursday. They would leave the policy tougher 
than other recent proposals. 

Under the new policy, eighth-graders would move to ninth grade only if: 

• They pass both the English and math parts of the LEAP, 
either in the spring or on a summer retest. 

• Or, after repeating eight grade, they pass at least one part of 
the LEAP test, take summer classes and take a ninth-grade 
remedial class in the subject they failed. The original 
proposal would have let students move to ninth grade even if 
they failed the entire test twice. 
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Now, schools can move eighth graders who fail LEAP to “8.5” grades on 
high school campuses, where they take some ninth-grade classes but also must 
take remedial classes in each LEAP subject they failed. Students must take 
summer classes to be eligible for that option." 

Other types of prominent “reporting” themes included general policy 
implementation around testing (e.g., upcoming test schedules, how schools were 
preparing for tests such as holding pep rallies, educators’ and parents’ worries about 
upcoming tests and stakes attached to them) and how students fared on tests (e.g., what 
percentage of students statewide and locally passed the recent LEAP or GEE tests). A 
cross section of this type of reporting was included in the portfolio. As part of this type 
of reporting, stories emerged discussing Louisiana’s system of labeling schools. Based 
on test scores from 1999 and 2000, 2001 was the first year in which these kinds of stories 
appeared discussing how schools were faring (e.g., public documentation of specific 
schools and school districts that were succeeding and those that were failing according to 
student performance on tests). Similarly, many stories documented the system of 
sanctions and rewards schools did (or could) receive based on how their students fared on 
the statewide tests. 

For example, in 2001, a story on the most recent round of testing and school 
improvement revealed that one district had schools that had made improvements earning 
them rewards: 

All but eight of Jefferson Parish's public elementary and middle schools improved 
their academic scores enough during the past two years to avoid state-mandated 
reform measures, a new report shows. Fifty-seven of the 72 Jefferson schools 

Page 235 of 336 

This document is available on the Education Policy Studies Laboratory website at: 

http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0509-105-EPRU.pdf 





even improved enough to earn cash rewards from the state, which could total 
about $750,000 for instructional enhancements, based on a state formula. The 
eight schools that fell short of goals set by the state will be placed on a track for 
reform. 

As part of its school accountability effort, the state first assigned ratings to 
schools in 1999 based mostly on standardized test scores with partial 
consideration for attendance and drop-out rates. Those ratings were the basis for 
two-year improvement goals set for each school. The schools achieving 
“exemplary” and “recognized” growth will get money from the state, awarded on 
a per-pupil basis from a $10 million pot. Exemplary schools, which exceeded 
their growth targets, will receive $26.25 per student. Recognized schools, which 
met their targets, will receive $17.50. Individual schools will decide how to 
spend the money, subject to state regulations. But some schools that failed to 
reach their targets will begin “corrective actions,” which include help from a 
school district team of educators and the required writing of an improvement plan. 
When comparing just 1999 scores to just 2001 scores, the school in Jefferson that 
showed the most improvement was Westwego Elementary. Its 40.3-point 
increase earned it a label of “exemplary academic growth.” 100 

Finally, there were several “editorials” during this time. Some supporting the 
institution of Louisiana’s “tough” accountability laws: 

Yes, LEAP testing is fair to the children of Louisiana. Yes, it is appropriate to 
hold everyone accountable for the success of our children, including parents, 
teachers school officials and most importantly our students. We need to start with 
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our children. They are the foundation for our future. If you were building a 
house, you wouldn't start with the roof. You'd start with the foundation. If 
children don't learn to read and write at appropriate grade levels, they'll never 
graduate anyway. 

It's not going to improve our children's self-concept if we continue to pass 
them along even though they have not learned what they need to be successful at 
the next grade level. 101 

And some opposing it: 

The rhetoric of calling for “tougher standards” and the mania of high-stakes 
testing are doing harm to young people here and across the nation. 

Teachers are being reduced to test-prep technicians and students are bored 
out of their skulls with constant drilling and test practice. 

The real tragedy is that students aren't learning and are in fact dropping 

out. 

What do the tests measure anyway? Speed, recall and test-taking skills. 
What the tests do not measure are curiosity, initiative, empathy, 
improvement, honesty, diligence and creativity. 

BESE should end reliance on the LEAP as the sole criterion on which to 
base decisions that have such a large impact on the lives of young people. 102 

2003-2004 

Because the search of this time period was conducted in March of 2004, it 

consisted primarily of coverage of 2003 events; many stories documented events before, 

during, and after the spring 2003 administration of LEAP. During the spring of 2003, 
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many stories documented how schools were preparing students for the LEAP. These are 
evidenced in several headlines: “Pep rally last stop before LEAP test,” “Rally to psych 
LEAP students: It’s a chance to let off steam before big test,” “Algiers fourth-graders 
prep for LEAP with feast: Teachers try to calm youngsters’ nerves,” and “Schools, 
churches help kids with LEAP: High-stakes testing planned for March.” 

In April 2003, a detailed article showed the most recent district-level ratings and 
how they were calculated: 

In results released Thursday, school districts throughout Louisiana were rated on 
their academic achievement. The district wide rankings are based on District 
Performance Scores, which are developed from: 

• Fourth- and eighth-grade scores in spring 2002 on the Louisiana 
Educational Assessment Program for the 21st Century, known as 
LEAP 21. 

• Third-, fifth-, sixth- and seventh-grade scores on the Iowa Test of 
Basic Skills last year. 

• Tenth- and 1 lth-grade scores on the Graduate Exit Exam for the 
21st Century, or GEE 21, taken last spring. 

i m 

• Attendance and dropout figures from the 2000-01 school year. 

Several editorials appeared arguing the pros and cons of Louisiana’s 
accountability system. For example, one writer argued against the use of tests to 
determine whether students receive a diploma: 
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Surely it's easy enough to settle the big row over the alleged unfairness of 
preventing high school seniors who fail the exit exam from walking across the 
stage on graduation day. 

Let those who fail do the grad walk with everyone else. Just make them 
wear large conical hats emblazoned with a D. 

That way everybody would be happy and we'd really be getting back to 
basics. 104 

Another provided a more positive view, arguing that the use of LEAP was not racist: 

Claude Steele, a psychologist at Stanford University, has written about the 
phenomenon he calls "stereotype threat." He says people generally have a more 
difficult time performing if they fear their failure will be used to confirm a 
negative stereotype of their group. 

Those who protest that the LEAP is designed to hurt African American 
students, those who make comparisons to poll taxes and weapons of mass 
destruction, may think they're helping, but if Steele's study is any guide, they're 
really making it more difficult for African American students. 

African American students can do well on this test. I know they can. But 
they need to believe that the LEAP isn't a white supremacist plot. They need to 
know that the African American people who love them want them to take it and 
do well on it, too. 105 

Later in 2003, stories emerged discussing the issue of increasing the LEAP 
passing standards for fourth and eighth grade students to progress to the next grade. Some 
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believed the state should definitely increase the standards as written about in The 



Advocate published in Baton Rouge: 

If Louisiana is serious about school accountability, then the state Board of 
Elementary and Secondary Education ought to insist that standards for promotion 
on the LEAP tests be as rigorous as possible. 

We don't believe it is in the interests of students -or the political viability 
of the accountability program - to delay imposing the same standard for eighth- 
graders as for fourth-graders. Students should be pushed by the program, as 
school districts should feel pressure to do better in preparing middle-school 
students for high school. 106 

Ultimately, the state board of education passed a resolution, increasing the standards for 
passing for fourth and eighth graders in 2004. 

Another political issue of some prominence was whether the state should have the 
authority to take over chronically failing schools. One public group supported this idea, 
“State takeover of foundering schools and a limited use of vouchers are two controversial 
steps that have won support from a New Orleans civic group that issued a report Tuesday 
on public education.” The measure was ultimately passed, after which stories appeared 
describing the fallout, including stories about the pressure some schools felt as a result of 
this “threat.” For example, one school hired a new principal: “Prescott Middle School, a 
school trying to stave off state takeover, has an unusually distinguished faculty this year, 

1 0R 

thanks to the recent hiring of Michael Comeau.” 
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In the fall of 2003, after the most recent school-level labels were released, it was 



reported that several schools faced state assistant and intervention for not making 
academic progress: 

The assistance could include a forced redirection of some school district money to 
buy extra supplies and to cover the cost of tutorial services and other types of 
remediation. Schools also receive help from teams of educators using special state 
funds. 

In the most poorly performing schools, the state could step in to force the 
schools to completely reorganize and possibly bring in entirely new staffs to run 
the schools. Parents also could choose to send their children to better-performing 
public schools. Eventually, the schools could be forced to shut down. Seventeen 
schools, all but one in New Orleans, are eligible for BESE takeover in the 2004- 
05 school year under the guidelines of the constitutional amendment approved by 
voters last month, according to Jacobs. 109 

Supplemental Search: Google 

A search was conducted on March 14, 2004, covering the previous 30 days. 
Several search terms were used to probe for the widest selection of stories. A selection of 
these stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A supplemental search was conducted seeking out stories specifically addressing 
consequences to schools, districts, teachers, and/or students. This search 110 was 
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conducted over the previous year and yielded 110 stories, of which 19 were downloaded 



for further consideration and review. 



Mississippi 

A search 111 was conducted across the entire LexisNexis universe of news media 
112 

available in Mississippi. “ This initial search, extending across the entire universe of 
news articles yielded 207 stories dating back to July 1998, of which 57 were downloaded 
for further review. 

Content Analysis 

The number of stories that were reviewed based on year and primary content are 
presented in Table 8. A description of the primary themes of these stories across time is 



described next. 

Table 8: Story Tallies by Year and Category for Mississippi 


Year 


Number of Stories 


Category* 


Number of Stories 
per Category 


1998 


3 


R 


3 


1999 


9 


R/L 


4/5 


2000 


7 


R/L 


2/5 


2001 


4 


R 


4 


2002 


4 


R 


4 


2003 


26 


R/L 


24/2 


2004 


4 


R/L 


2/2 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 
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1998-2002 



In these earlier years of reform in Mississippi, much of the coverage recovered 
from LexisNexis included stories that “reported” on legislative initiatives and voting 
patterns. These stories documented the range of issues the Mississippi legislature was 
debating and voting into law. For example, a February 1999 article recounted the most 
recent senate- approved proposals: 

Principals, teachers and even janitors in thriving schools could get bonuses as part 
of a Senate plan that targets progress in individual schools. 

Mississippi has a dozen school districts ranked excellent, but that can be 
deceiving because some schools in those districts have poor test scores and there 
are successful schools in districts with low rankings. 

The bill approved Thursday by the Senate would rank schools individually 
and set up goals for each. If standards are reached, principals and teachers could 
receive $ 1,000 bonuses and cafeteria workers, janitors and teacher assistants 
could receive $ 500, state officials said. 

"Typically good schools have a team and that team doesn't exclude 
anybody," said State Superintendent of Education Richard Thompson, who 
believes the bonuses will boost morale. "It's a concept of rewarding a team for a 
job well done." 

The bill also gives far-reaching authority to conservators appointed for 
chronically troubled school districts. They would oversee hiring and spending by 
districts and the assignment of staff. They could also determine if the district 
would have athletic programs. 113 
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Other articles, especially in 1999, documented the changing educational 
assessment and accountability system. For example, in October of 1999 an article 
described the upcoming new assessment: 

Results from tests designed to measure student progress in public school grades 2- 
8 will be fed into a revamped accreditation system in 2001, according to State 
Superintendent of Education Richard Thompson. 

The system is designed to identify how well school districts and individual 
schools are teaching students, and if they are doing a better job from year to year, 
he said. 

The tests will be administered during the first week of May. 

About 280,000 of the state's 500,000 public school students will take the 
exams, which use mostly multiple-choice questions in math, language arts and 
reading. 114 

Between 2000 and 2002, a variety of issues were covered in the press. In 2000, 
several articles discussed the debates of merit pay (tying teacher bonuses to student 
achievement), the new accountability legislation that continued to evolve, and policies 
around how (or whether) to incorporate out of state transfer students’ scores into the state 
accountability system. Further, as the new assessment system was implemented, several 
stories described state and local student performance. In 2002, one article described how 
fewer schools were labeled as “low performing” because students’ test scores were going 
up: 

Mississippi saw a dramatic decrease in the number of schools falling below state 
academic standards. 
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There were 122 Mississippi schools that did not meet statewide testing 



targets during the 2000-2001 school year. That number dropped to 11 in 2001- 
2002 . 

“We are very pleased that the number of schools in need of improvement 
has been substantially reduced,” state Superintendent of Education Henry L. 
Johnson said Tuesday in a written release. “We will do everything in our power 
to help those schools in need of assistance.” 115 

2003-2004 

Throughout 2003, there seemed to be increased coverage on school and district- 
level consequences that were tied to student performance. In 2003, the federal- and state- 
mandated system of sanctions were described: 

Federal sanctions for schools not meeting adequate yearly progress under No 
Child Left Behind for two consecutive years. 

• Year 1 - Offer option to move to other schools within the district. 

• Year 2 - Offer choice and supplemental services. 

• Year 3 - Offer choice and supplemental services and at least one 

other corrective action. 

• Year 4 - Offer choice and supplemental services and plan for 
alternative governance. 

• Year 5 - Implement alternative governance. 

Mississippi sanctions for priority, low-performing schools. 
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Year 1: 



• Site based assessment of the school by trained evaluation 
team. 

• Report presented to community at an advertised meeting. 

• Development of school improvement plan through an 
established parent/citizen advisory council. 

• Individual professional development plans developed for 
personnel identified as needing improvement. 

Year 2: 

• A teacher who fails to perform after re-evaluation will be 
recommended for dismissal. 

• A principal, who has been at the school for three or more 
years, will be recommended for dismissal. 

• A cap can be placed on the superintendent's salary. 

Year 3: 

• A superintendent can be dismissed or subject to recall. 

• School board members can be dismissed or subject to 
recall. 116 

Most stories then recounted school and or district progress toward meeting both 
state and federal achievement goals. For example, in August of 2003 it was reported: 

Three public schools got some good news Friday when the state Department of 
Education removed them from a finalized list of schools that need improvement 
under a new federal law. 1 17 
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Similarly, in another August 2003 story, it was reported: 



Ray Brooks School Principal Barbara Akon started this year on a positive note - 

her school is no longer ranked among the state's lowest performing. 

The 300 students at the pre-kindergarten through 12th grade school in 

Benoit are now performing better, along with their teachers, Akon said. 

In just one year, the school managed to raise itself from Level 1 to Level 3 

in its recommended ranking, Akon said. Five is the highest level in the state's 

118 

new accountability system. 

A selection of stories covering the range of issues described above are included in the 
portfolio. 

Supplemental Search: Google 

A search was conducted on April 1, 2004, covering the previous 30 days. Several 
search terms were used to probe for the widest selection of stories. A selection of these 
stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A search confined to the immediately preceding year was conducted looking for 
specific articles on consequences dolled out to students and/or school personnel in the 
form of rewards (incentives, bonuses) and sanctions (retention, school takeover). The 
search 1 19 produced 65 stories and 10 were downloaded for more careful review. The 
most relevant stories that did not duplicate stories from the main search are included in 
the portfolio. 
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Missouri 



120 

A search ~ was conducted across the entire LexisNexis universe of news media 
available in Missouri. “ This initial search returned 467 stories dating back to 1988. 

The analyses of achievement data are confined to events in 1990, so a second search, 
using the same search string but confined to the time period of January 1990 and beyond, 
produced 457 stories, of which 64 were downloaded for further review. 

Content Analysis 

The numbers of stories that were reviewed based on year and primary content are 
presented in Table 9. A description of the primary themes of these stories across time is 
described next. 



Table 9: Story Tallies by Year and Category for Missouri 



Year 


Number of Stories 


Category* 


Number of Stories 
per Category 


1990 


2 


R/O 


1/1 


1992 


1 


R 


1 


1994 


1 


R 


1 


1996 


1 


R 


1 


1998 


2 


L 


2 


1999 


3 


R 


3 


2000 


8 


R/L/O 


4/1/3 


2001 


11 


R/L/O 


4/1/6 


2002 


10 


R/L/O 


6/2/2 


2003 


12 


R/O 


10/2 


2004 


7 


R/O 


5/2 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L= legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and PI=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 
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1990-1999 



There were very few stories relating to high-stakes testing or educational 
accountability during 1990 - 1999. Still, those that did emerge primarily covered the 
evolving standards, assessment, and accountability policies that were being considered 
for adoption. For example, in 1994, the media outlined the new standards that were being 
considered: 

Within three years, public school students in Missouri could be checking off 
fewer multiple-choice questions and writing more essays on their statewide 
achievement tests. They could even be doing experiments to show what they 
know. 

This is all part of a three-step state drive to reform public education. A 
group of 150 teachers from across the state has just taken the first step by drafting 
41 academic standards by which all students might be measured. 

The proposed standards, released last month, have already drawn fire from 

122 

two people who helped to review them. 

And, in 1996, with the release of the first statewide report cards, an article described the 
most current policies around public reporting: 

Are students learning? And how much are they learning compared with other 
students? 

What the public might have wanted to know most is hard to tell from the 
first yearly "report cards" Missouri public school districts issued earlier this 
month. 
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As the state Department of Elementary and Secondary Education decreed, 
the reports include students' achievement test scores along with reams of data on 
such matters as finances, staffs, courses of instruction and extracurricular 
activities. 

But the department didn't require a particular test or format for reporting 

scores. 

So different districts reported different scores from different tests in 
different ways. Some printed charts; others, columns of numbers. Few cited 
averages or other statistical benchmarks or offered interpretations of the numbers 
and pictures. 123 

By 1999, schools were labeled according to student achievement: 

St. Louis Public Schools officials have ordered 40 schools to make significant 
improvement in test scores — or face staffing changes. 

The schools will be required to adopt new instructional programs and to 
improve test scores, attendance rates and dropout rates. Twenty-nine of the 
schools are new to the list as of Tuesday. Eleven others were chosen in January 
1998. 

Unless the schools improve, their principals could be fired and some or all 
of the teachers transferred to other schools. That process is called reconstitution, 
and three of the 1 1 schools named last year are expected to undergo that process 
this summer, said Larry Hutchins, the school system's director for accountability. 

All of the city's nonmagnet high schools are now on the list. Roosevelt 
and Beaumont were added Tuesday to join Vashon. Sumner High is not on the 
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list but is being converted over the summer to a magnet program. Magnet schools 



offer special programs that draw students outside the regular attendance 
boundaries and from St. Louis County. 

Ten middle schools and 17 elementary schools also were placed on the list 
Tuesday. 

And the public was informed as to how Missouri students performed on the latest round 
of standardized achievement testing: 

Missouri's public school students scored slightly higher at most grade levels on 
this year's state standardized tests than students scored on last year's tests. 

But roughly two-thirds or more of students failed to meet state standards 
on this year's Missouri Assessment Program tests in math, science, reading and 
writing. In math and science, more than 80 percent of students in middle school 
and high school scored below state standards. 

The best performance in all grades came on tests for reading and writing. 
Across the nation, officials have raised the stakes for standardized tests, 
using them to hold schools and teachers accountable, to decide whether a student 
advances to the next grade or graduates, and even to help determine a student's 
grade. 

In Missouri, state officials will use the test results to help decide whether 
to accredit school districts. Accreditation for districts such as St. Louis and 

124 

Kansas City is pending now. 
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2000-2004 



By 2000, the state’s vision for accountability was becoming more streamlined — 
and more “editorials” appeared either supporting or protesting the movement. In 2000, 
one writer expressed the problems with really knowing how a local school ranks against 
other schools in the state. She suggests that instead of just looking at test scores, 
community members should adopt the following strategy: 

I suggest that parents ask their elementary child's school what percentage of its 
students are reading within two grade levels of where they are supposed to be. In 
the 1999 session, the Legislature passed an amendment I had sponsored, 
prohibiting the social promotion of students who are more than two years behind 
in reading. This standard does not apply to students in special education. Every 
school in this state has now had almost 18 months to identify those students not 
meeting the standard and to provide them with whatever additional assistance was 
necessary. If your school can assure you that all their students are reading, we 
can assume that their students also will be learning. If we cannot teach every 
student to read, we will never have "world-class" schools. 

In 2001, there were more editorials, primarily lamenting the problems of high 
stakes testing. For example, one writer argued that for students who experience life- 
altering trauma, a test score does not adequately represent what they know and can do — 
especially if they are tested on days when they are feeling bad. Similarly, another writer 
complained that a one-size-fits-all policy is undermining our children’s educational 
experiences: 
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How did we get here? In 1983 a single federal report claimed that we were "A 



Nation At Risk" and said the state of public education in America was 
horrendous. Every school in America was lumped together. Governors, 
legislators and corporations all jumped into the fray with reform agendas and 
"silver bullets." Instead of dealing with our archaic factory model of education, 
they assumed that all school districts were alike, that students were widgets to be 
produced and that testing was the answer. Instead of respecting the uniqueness of 
our learners, the inclusive nature of public schools, and new knowledge about 
learning and technology, reformers advocated one-size-fits-all strategies. 126 

In 2002, a variety of issues were described and debated, including a proposal for 
tying achievement results to district-level bonuses, the problems of grade inflation, and 
the new accountability law that was passed. This article outlined the new and updated 
legislative mandates for educational accountability. Included among them: 

• Schools with high student achievement will be classified as "performance 
schools" and freed from some state rules. 

• Schools with poor student achievement will be classified as "priority schools" 
and subject to more state requirements. The classification includes 
unaccredited or provisionally accredited districts as well as individual schools 
where students fare poorly on state standardized tests. 

New Requirements: 

• Poor performing schools must come up with general improvement plans and 
develop individualized plans for poor performing students. 
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• School plans must include at least one of the following: smaller class sizes or 
learning groups; full-day kindergarten or preschool; after-school tutoring; 
home visits by teachers; employment of nationally certified or regional 
resource teachers. 

• Teachers and administrators in poor performing schools must participate in a 
mentoring program, work toward national certification or become certified as 
a scorer for the state's standardized tests, unless they already have met similar 
standards. 127 

Over the course of 2003-2004, there were a variety of issues expressed in the 
media. A cross section of these issues is presented in the portfolio. 

Supplemental Search: Google 

A search was conducted on March 4, 2004, covering the previous 30 days. 

Several search terms were used to probe for the widest selection of stories. A selection of 
these stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A search of March 2003 through March 2004 was conducted looking for specific 
articles on consequences dolled out to students and/or school personnel in the form of 

1 9R 

rewards (incentives, bonuses) and sanctions (retention, school takeover). The search “ 
yielded 96 stories, of which nine were downloaded for more careful review. 
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New Mexico 



1 9Q 

A search was conducted across the entire LexisNexis universe of news media 

1 TO 

available in New Mexico. This search returned over 331 stories dating back to 1995. 
Redundant and irrelevant stories were eliminated (some news coverage extended to other 
states such as North Carolina), leaving 84 stories that were downloaded for closer review. 

Content Analysis 

The numbers of stories that were reviewed based on year and primary content are 
presented in Table 10. A description of the primary themes of these stories across time is 
described next. 



Table 10: 


Story Tallies by Year and Category for New Mexico 


Year 


Number of Stories 


Category* 


Number of Stories 
per Category 


1996 


4 


L/O 


3/1 


1997 


1 


R 


1 


1998 


2 


R 


2 


1999 


10 


R/L 


7/3 


2000 


13 


R/L/O/PI 


7/3/2/1 


2001 


13 


R/L 


12/1 


2002 


17 


R/L/O 


14/1/2 


2003 


19 


R/L/PI 


15/3/1 


2004 


5 


R/L 


4/1 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



The collection of stories downloaded for review to describe accountability 
activities in New Mexico revealed a few prominent themes that can be best described in 
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chronological order. From 1996 through 1999, many stories were “reporting” in nature 
and documented the ongoing policy changes in the state (R/p). For example, in 
September 1997, one story talked about the new tests that were going to be implemented: 

When New Mexico students sharpen their No. 2 pencils to take standardized tests 
this school year, they'll do more than just fill in multiple-choice bubbles. 

Beginning next spring, students in fourth, sixth and eighth grades will be 
taking a new kind of standardized test, one that mixes in open-ended questions 
that require short, written answers. 

Traditional, multiple-choice questions will still be part of the new test, but 
education officials are following a national trend to design standardized tests that 
evaluate students' problem-solving skills. 

The new test is also unique in that part of it will be designed specifically 
to meet new education standards recently adopted by the state Board of 
Education. 

In other words, it will be "uniquely New Mexican," said state 

1 T 1 

Superintendent Michael Davis. 

Later, in 1999 a story documents the debates around the proposed new accountability 
system: 

High-stakes student testing is driving school reform. But is it a good measuring 
stick? 

Sharpen your No. 2 pencil, take a deep breath and open your test booklet. 
Now prepare for your school, your teacher and your fellow students to be judged 
by how well you do on this test. 
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Standardized testing has been a tool for schools for decades. 

Now they're being used nationwide, not only to measure, but to rank 
schools and hold educators accountable for improving student learning. 

The trend arrived in New Mexico two years ago, and many educators 
question the fairness of relying so heavily on testing. Supporters of testing say it 
is the bedrock of accountability. 

While that debate plays out, high-stakes testing is here. And Armijo 
Principal Christine Lopez said the pressure is on administrators, teachers and 
students to improve the school's scores. 

Simple things like incorporating test-taking skills into everyday lesson 
plans, combined with individual tutoring for kids who struggle on the tests, is 
working, she said. 132 

This sets the stage for what kind of tests students take during the course of the next few 
years and how they perform. 

Many reports appearing throughout 2000 and 2001 described implementation of 
the new accountability system and presented debates arguing for and against the use of 
tests for measuring schools and students. For example, one story gave the perspective of 
one administrator who argued that holding schools accountable based on the statewide 
TerraNova test results was a bad idea because tests can be flawed: 

State Needs Own Exam, Official Says 

The Bernalillo Public Schools superintendent is proposing that New 
Mexico come up with its own method of testing students, saying the current test 
has a flaw that will always guarantee failure. 
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I believe that this flaw is so serious, however, that no matter how hard 



many of us try we will never be able to demonstrate enough success to remove us 
from a negative list," Gary Dwyer told school administrators attending a state data 
and accountability conference Thursday in Albuquerque. 

He said the state needs to create its own criterion-referenced test, such as 
the Texas Assessment of Academic Skills. Such tests are drawn up based on the 
state's own personalized set of standards. 

While New Mexico has a state standards portion included in its annual 
test, the CTB-McGraw Hill Terra Nova exam, Dwyer said it isn't enough. 

Another prominent theme found throughout the news was “reporting” in the sense 
that student scores or school-level labels were released. In 2000, a news story showed 
that schools were improving accounting to the current accountability system: 

New Mexico's new school accountability ratings have been released, and they 
show that more schools across the state meet or exceed national standards than 
fall below them. 

The ratings, reported Friday at the state Board of Education meeting in 
Gallup, cover 651 public schools around New Mexico. Nearly three-fourths of 
them met or exceeded standards, but 172 were listed as probationary. 

Of the 479 schools that met standards statewide, 37 were rated exemplary 
and 52 exceeded standards. 

New Mexico has rated public schools in the past. But the board approved 
a new accountability system in June. The new ratings are based primarily on 
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student performance on a national standardized tests but also take into account 
attendance figures and dropout rates. 134 

Later, a 2001 report documented the wide disparity in rankings across the state, 
highlighting the dramatic differences in two districts: 

Local school districts' rankings among the state's 89 districts on proficiency tests 
scores ranged from Rio Rancho with overall high marks to Bernalillo's lower but 
somewhat improved marks. 

The state's annual accountability report, released Friday, compares the 
state's 89 districts in areas such as standardized testing, graduation rates and 
dropout rates. This year, the state also included the percentage of special- 
education students who drop out. 

1 OC 

Rio Rancho outperformed Albuquerque and Bernalillo in most areas. 

Supplemental Search: Google 

A search was conducted on March 16, 2004, covering the previous 30 days. 
Several search terms were used to probe for the widest selection of stories. A selection of 
these stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A supplemental search 136 was conducted seeking out stories specifically 
addressing consequences to schools, districts, teachers, and/or students. This search of 
March 2003 through March 2004 returned 37 stories, of which most were irrelevant. 

Still, 10 were downloaded for careful review. A selection of the most relevant stories 
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(and those that do not repeat stories already included in the portfolio) is included in the 



portfolio. 

New York 

A LexisNexis search of stories circulated throughout New York State was 
conducted in three time segments. The first search, confined to the time frame of January 
1, 1990, to December 31, 1997, 138 produced 86 hits, of which 18 were downloaded for 
more careful review. However, upon reading each story more closely, several more were 
eliminated from consideration because of irrelevancy or because they simply occurred 
too long ago, leaving eight stories from this time frame for possible inclusion in the 
portfolio. A second search conducted over January 1, 1998, to December, 31, 2000, 139 
yielded 235 hits, of which 84 were downloaded for more careful review. Many of these 
stories were deleted due to repetitiveness or irrelevancy — leaving 35 for portfolio 
consideration. 

A last search conducted over the time period of January 1, 2001, to February 24, 
2004, 140 yielded 298, of which 71 were downloaded for more careful review. Again, 
after careful review, many of these 71 stories were eliminated from consideration because 
of redundancy, leaving 44 for portfolio consideration. 

Content Analysis 

The numbers of stories that were reviewed based on year and primary content are 
presented in Table 11. A description of the primary themes of these stories based on time 
frame and primary content category is described next. 
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Table 11: Story Tallies by Year and Category for New York 



Year 


Number of Stories 


Category* 


Number of Stories 
per Category 


1996 


4 


R/O 


2/2 


1997 


4 


R/L/O 


2/1/1 


1998 


7 


R/O/PI 


2/1/4 


1999 


16 


R/L/O/PI 


10/1/4/1 


2000 


12 


R/L/O/PI 


6/4/ 1/1 


2001 


13 


R/O/PI 


9/2/2 


2002 


10 


R/O/PI 


5/2/3 


2003 


18 


R/L/O/PI 


9/2/4/3 


2004 


3 


R/PI 


2/1 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L= legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



1990-1997 

Eight stories from this time frame were carefully reviewed for portfolio inclusion. 
In general, most story contents centered on the merits of the Regents examination in New 
York State. For example, there were several “editorials” where students were lamenting 
the problems of the Regents examinations. For example, the headline of one editorial 
that appeared the Buffalo News read, “No correlation between Regents examination and 
success.” 141 In this article, the writer notes: 

The Regents examinations have been around for decades. As most students are 
well aware, this high-stakes “snapshot in time” is one of the poorest indicators of 
40 weeks of learning that has been developed. Standardized tests such as the 

142 

Regents exams have never improved instruction. 



Page 261 of 336 

This document is available on the Education Policy Studies Laboratory website at: 

http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0509-105-EPRU.pdf 








Most stories around this time that were opinion in nature decried the use of tests 



as a sole predictor of future success. Some stories were more correctly categorized as 
“reporting” in nature that discussed and debated the policies of using students’ test scores 
as a way of holding students and schools accountable. In fact, The New York Times did a 
story on one district that was the first to be taken over by the state because of, among 
other things, low student achievement. The article notes: 

Almost two months into the state takeover of the Roosevelt school system — the 
first such action in New York history — teachers, parents and students say they 
see signs of improvement in a district long plagued by low student achievement, 
rock-bottom morale and a sense of defeat. 

“There is more hope than doubt,” said David Carroll, a high school teacher 
and president of the Roosevelt Teachers' Union. 

Under special legislation passed last year, the state was given unusual 
powers to intervene in Roosevelt, and the Board of Regents appointed a panel to 
oversee a recovery plan for the district. Last month, with panel members 
asserting that the local school board had resisted the plan and was guilty of 
flagrant mismanagement, the Regents ousted the Roosevelt board, authorizing the 
panel to run the district until new school board elections on May 21. 143 

Lastly, there are also a few stories reporting on students’ scores on the latest round of 
Regents testing. A selection of stories is included in the portfolio to represent the range 
of issues. 
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1998-2000 



During this time period, stories emerged representing the legislative changes in 
the state for promoting greater academic accountability. A large number of stories were 
coded as “reporting” (18) with many of them reporting on the changing accountability 
and assessment policies. For example, in 1998 there were many stories discussing how 
the pressures of testing were affecting fourth graders. In 1998, the Associated Press 
released a story discussing the new era of testing for New York students: 

January [1999] begins a series of challenging tests in New York schools - 
challenging for schools as well as students. 

On Jan. 11, fourth-graders will begin a new, three-day reading and writing 
test that some educators fear will be beyond their ability. Two weeks later, many 
1 lth-graders will take an English Regents test that they'll have to pass at some 
point in order to graduate from high school. 

Welcome to one of the toughest eras New York schools have yet faced. 144 

In 1999, many stories debated the merits of the Regents examination schedule and 
pressures on young students. One New York Times editorial argued that testing was 
putting too much pressure on students. The headline read: “New Tests Are a Stressful 
Measure.” In June of 1999, several “reporting” articles appeared discussing the newest 
round of testing and the possible effects on students and schools that do not fare well on 
them. The New York Daily News reported: 

With the dismal results of the state's new fourth-grade English exams still fresh in 
the minds of the city's disappointed educators and parents, students began another 
round of high-stakes tests yesterday. 
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About 64,000 eighth-graders returning from a long holiday weekend 



tackled the first day of a grueling week of state exams in English and math. And 
75,000 fourth-graders today will begin a three-day math test that for the first time 
will require them to explain how they arrived at answers. 

State Education Commissioner Richard Mills has vowed to use the scores 
to identify failing schools for state takeover. 145 

In 2000 a series of articles, both reporting- and opinion-oriented stories detailed 
how students performed on the most recent Regents examination. In October of 2000, 
the New York Times reported that “more than three-quarters of New York City's eighth 
graders failed to reach acceptable levels on a statewide mathematics test last spring, 
raising serious questions about whether they will be able to pass a newly required 
Regents math exam before they graduate from high school in 2004.” 146 Stories emerged 
talking about how these tests are biased against some student groups. An editorial in the 
Albany paper argued, “Tests are biased against minorities and the poor.” 147 

2001-2004 

In the most recent group of stories, there were many articles discussing the merits 
of high-stakes testing. Article writers questioned the use of “high stakes” testing as a 
measure of schools and students, and again, there were those who argued that exams were 
putting too much pressure on young people. In Albany, one article writer argued, “A 
rebellion is brewing among some parents and educators who believe elementary school 
children are being subjected to what one researcher called an almost inhumane amount of 
‘high-stakes’ standardized tests.” 
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Throughout 2002, dissention against high-stakes testing grew. One editorial 



writer complained it stifled creativity and there were several stories of local communities 
and parents who were boycotting the Regents exam. This occurred in Buffalo and in 
Syracuse. 

There were also policy-related articles that documented policy makers’ 
discussions around merit-pay, considerations to principals for increased achievement, and 
an article documenting the accommodation changes for student test takers with 
disabilities. 

Throughout 2003, the dominant theme was centered on the problems with the 
Regents math exam. Many high school students failed the exam causing the public to 
question its validity and fairness. Consequently, the exam was rescored and ultimately, 
policy makers decided to throw out the exam as a requirement for graduation. The major 
fallout of this incident was the controversy over what the graduation requirements would 
be. Some argued it should be raised — making it harder to get a diploma, whereas others 
wanted it to stay the same. Arguments on both sides were presented and are selected for 
inclusion. 

Supplemental Search: Google 

A search was conducted on March 3, 2004, covering the previous 30 days. 

Several search terms were used to probe for the widest selection of stories. During this 
time many stories centered on the issues of schools having to close due to weather and 
how the testing schedule would be revamped. Stories most relevant to current 
accountability issues were included. 
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Supplemental Search: LexisNexis 



A search of March 2003 through March 2004 was conducted looking for specific 
articles on consequences dolled out to students and/or school personnel in the form of 
rewards (incentives, bonuses) and sanctions (retention, school takeover). The first search 
yielded over 1,000 documents. 149 Therefore, searches were disaggregated into two 
categories based on type of consequence (reward versus sanction). The first of these two 
searches considering only rewards as consequences 150 returned 20 hits, 13 of which were 
downloaded for more careful review. A second search looked for sanction-oriented 
stories. This search 1 " 1 produced 88 stories, of which seven were downloaded for more 
careful review. Selections of stories representing the major issues from these two 
searches were included in the portfolio. 

Rhode Island 

1 59 

A search conducted across the entire LexisNexis universe of news media 

1 59 

available in Rhode Island yielded 573 stories dating back to 1994. After redundant, 
irrelevant, and obscure stories were eliminated, 98 were downloaded for closer review. 

Content Analysis 

The numbers of stories that were reviewed based on year and primary content are 
presented in Table 12. A description of the primary themes of these stories across time is 
described next. 
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Table 12: Story Tallies by Year and Category for Rhode Island 



Year 


Number of 
Stories 


Category* 


Number of Stories 
per Category 


1995 


2 


L 


2 


1997 


4 


R/O 


3/1 


1998 


18 


R/L/O 


10/6/2 


1999 


18 


R/L/O 


10/6/2 


2001 


7 


R/L 


6/1 


2002 


21 


R/L/O/PI 


14/3/1/3 


2003 


21 


R/L/O 


18/1/2 


2004 


6 


R/L/PI 


4/1/1 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



From 1995 to present, stories were primarily categorized as “reporting.” The 
range of these stories, however, varied over time as the policies changed. From 1995 
through 1999, many of the “reporting” stories were political in nature — stories with 
themes recounting the current policies. For example, in 1997 a story documented the 
new practice of publicizing school-level report cards. The article notes: 

Parents, educators and taxpayers take notice: accountability in public education is 
coming to Rhode Island. It will start with report cards, to be issued annually for 
every elementary and secondary school in the state. They will chronicle student 
and teacher attendance rates, class sizes, how schools spend their money and how 
students perform on a newly designed statewide test. 

The new test, given to fourth-, eighth- and lOth-graders last spring, sets 
the bar considerably higher than the Metropolitan Achievement Test, which has 

been the measure of student performance in Rhode Island for years. 154 
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Subsequently, many of the stories in 1998 discussed the legislative debates around the 
new accountability system that was transitioning in. For example, early in 1998, a new 
school-level survey was being instituted to gauge student and school personnel’s 
perspectives on their school. In January of 1998, this plan was announced: 

The School Committee last night officially welcomed the statewide SALT data 
survey into schools as a way of improving education. 

The survey, known formally as School Accountability for Learning and 
Teaching, will examine the thoughts and opinions of students, teachers and 
administrators, according to Robert Felner, chairman of the Department of 
Education at the University of Rhode Island. The resulting data can be used to 
overhaul or fine-tune ways in which students are taught by allowing schools to 
make planning decisions based on knowledge. 155 

Following this announcement there was a flurry of criticisms and debates arguing the 
merits of the policy. Some believed the SALT survey was too intrusive, others viewed it 
as necessary for understanding Rhode Island’s accountability process. 

Another primary issue in 1998 was the introduction of the new state academic 
standards and policy makers’ reactions to them. One headline revealed that a state school 
board member was unhappy with new “critical thinking” skills embedded in the state 
standards: “School board head impugns new state education standards: Glenn Brewer 
favors a curriculum that teaches a set of facts in the subject areas, rather than one 
emphasizing ‘critical thinking’ skills.” 156 

Throughout 2001-2002, there was a flurry of news stories reporting on students’ 
academic achievement on statewide tests. These stories addressed state trends as well as 
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how students in local communities fared. Additionally, a number of stories from this 



year reported on the SALT review process whereby a team of educators visit a school 
labeled as under performing and make evaluative recommendations. Examples of both 
positive and negative reviews follow. 

Positive 

On November 21, positive outcomes were reported in Bristol: 

Describing Byfield School as a monument to local history on the right track for 
the future, a group of state evaluators encouraged administrators to preserve the 
school’s unique educational qualities for future generations. 

The report is the result of a four-day visit, Oct. 30 to Nov. 2, by a five- 
member evaluation team under the state initiative called School Accountability 
for Learning and Teaching (SALT). The evaluation team sat in on classes and 
followed students. Members interviewed students, teachers and staff and 
reviewed students’ work, school policies and professional development, among 
other things. 

The unique opportunities of a small learning environment are exemplified 
at Byfield, the SALT team concluded. Its warmth, school pride and spirit and 
orderliness were recognized at the outset. 

In addition, parents, the team found, are a growing group of active 

157 

partners in the academic and social development of their children. 

Similarly, North Kingston received a positive review on December 7, 2001: 
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Wickford Middle School is doing a good job of teaching its students, but there is 
some room for improvement, according to a School Accountability for Learning 
and Teaching report recently released for the school. 

A group of educators from around the state spent five days at the school in 
October. The 11-member team observed 187 classes, spending a total of 140 
hours in direct classroom observation. Every classroom was visited at least once 
and almost every teacher was observed more than once. 

The goal of SALT visits is to help public schools improve learning and 
teaching. The Wickford team produced a 19-page report which included eight 
commendations and 13 recommendations for the school. 

Principal Tyler Page says the group did a good job evaluating the 
school. 158 

Negative 

On May 2, 2002, a mixed review came from one school in Burrillville: 

The principal, teachers and staff at the Steere Farm Elementary School are doing a 
good job, according to a recent survey, but there is a disconnect between the 
school and the district’s administration. The findings are part of the School 
Accountability for Learning and Teaching (SALT) program sponsored by the 
state Department of Elementary and Secondary Education, which dispatches 
teams of educators to evaluate schools across the state. 

A team visited Steere Farm from March 1 1 through March 15 although the 
report was not made public on a state Internet Web site until recently. 
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Kenneth Rassler, who became the school’s principal last year, said he was 
pleased with the report. I think it’s very fair and accurate, he said. 

Earlier this year, the state issued its school performance ratings based on 
students’ scores on the New Standards examinations. The state labeled schools 
high performing if at least 50 percent of its students had proficient scores. Steere 
Farm was the only school in Burrillville that made the cut. While the SALT team 
that visited Steere Farm issued a primarily complimentary report, it also issued 
some criticism. 

A disconnect exists in effective communication between the teachers at 
Steere Farm Elementary School and district-level staff, the report reads. The 
faculty reports that it feels neither supported nor appreciated by the district 
administration. This atmosphere could pose a significant obstacle for the 
successful implementation of district reform plans. 159 

Similarly, in Cranston, on February 19, 2003, a school received a markedly negative 
review: 

An evaluation team that visited Park View Middle School last fall as part of the 
state’s School Accountability for Learning and Teaching (SALT) initiative found 
a lot of areas that need improving, according to its recently released report. 

The SALT team concluded that Park View does not challenge its students 
enough, lacks a collegial atmosphere among its teachers and has an administration 
that is perceived as distant from the faculty. 

“The students are capable of so much more than is asked of them,” states 
the report drafted by the team of teachers, administrators, state education officials 
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and at least one parent. “Low expectations, a lack of academic rigor and 
inconsistent expectations for their behavior hold many students back.” 

Cranston school administrators said that they did not necessarily agree 
with everything that was in the report but were addressing the issues raised. 

“Our job is to look at what’s in the report, determine what is accurate and 
then fix it,” said Park View principal Gary Spremullo. “There is work to be done 
in the best of the schools, and we’re ready to do the work. That’s our job.” 

Supt. Catherine Ciarlo said, “I accept this report as a challenge.” 160 

Although a majority of stories centered on the SALT process and the SALT 
survey, several “editorials” debated the pros and cons of the SALT accountability system. 
A cross section of stories reflecting these major themes and viewpoints are included in 
the portfolio. 

Supplemental Search: Google 

A search was conducted on March 5, 2004, covering the previous 30 days. 

Several search terms were used to probe for the widest selection of stories. A selection of 
these stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A search confined to the immediately preceding year was conducted looking for 
specific articles on consequences dolled out to students and/or school personnel in the 
form of rewards (incentives, bonuses) and sanctions (retention, school takeover). The 
search 161 yielded 14 stories that were reviewed and two are included in the portfolio. 
Several additional searches using a variety of search strings were subsequently conducted 

to search out instances where consequences were dolled out to schools/district personnel 
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and/or students. Relevant stories discussing rewards and/or sanctions to students 



(scholarships, retentions) were nonexistent. A few stories reported on school-level 
rewards/recognition, using the search string: ALLCAPS (SALT) and school reward or 
recognition or success. Similarly, there was one story on a school’s failure to make 
progress (found using the search string: ALLCAPS (SALT) and school reform). All of 
those stories found under these additional searches are included in the portfolio. 

South Carolina 

A search 162 was conducted across the entire LexisNexis universe of news media 
available in South Carolina. 163 This initial search, extending across the entire universe of 
news articles returned more than 1,000 stories, and thus, adjustments had to be made in 
order to reduce the number of stories to a manageable set. A second search using a more 
restrictive search string 164 was conducted and produced 245 stories dating back to 1998, 
of which 79 were downloaded for more careful review and analysis. A review of these 
stories revealed that none of them were from the most recent three months. Thus, another 
search was conducted confined to the previous 90 days (January 2, 2004 - April 2, 

2004), 165 yielding 37 stories, of which 8 were downloaded. A final search 166 looking for 
articles between January 1, 1990, and December 31, 1997, was conducted yielding 154 
stories, of which 28 were downloaded for careful review. 

Content Analysis 

The numbers of stories that were reviewed based on year and primary content are 
presented in Table 13. A description of the primary themes of these stories across time is 
described next. 
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Table 13: Story Tallies by Year and Category for South Carolina 



Year 


Number of 
Stories 


Category* 


Number of Stories 
per Category 


1996 


14 


R/L/O/ 


7/3/4 


1997 


12 


R/L 


10/2 


1998 


4 


R/L 


3/1 


1999 


11 


R/L/O 


8/2/1 


2000 


20 


R/L/PI 


16/3/1 


2001 


19 


R/L/O 


14/2/3 


2002 


10 


R/O 


9/1 


2003 


13 


R/L/O 


9/1/3 


2004 


7 


R/L/O 


4/2/1 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



1990-1997 

In 1996, there was a flurry of media attention on the state legislature’s struggle 
with new standards and assessment. The 1996 bill was introduced and debated widely in 
the press; however, it was ultimately rejected by the legislature. In 1997, debates 
continued around what the state’s accountability system should look like. The role of 
incentives for improving student achievement was among these issues. For example, an 
October 1997 story described the debate around the role and reality of using incentives in 
education: 

South Carolina schools divide up a pot of millions of dollars each year to reward 
high achievement, but some state school board members think the system gives 
too much to wealthy schools that seem destined to do well. 
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Meanwhile, school districts identified by the state as being in the worst 



shape - those with test scores in the basement and dropout rates through the roof - 
aren't getting enough money to fix a problem that is decades old, the board 
members said. 

The School Incentive Reward Program, created by state legislation in 
1984, will give $ 5 million this year to individual schools. 

The rewards are doled out based on a formula that considers each school's 
scores and progress on the basic skills and the metropolitan achievement tests. 

The formula also looks at student and teacher attendance, and dropout rates. 

In affluent areas, test scores and attendance rates generally aren't a 
problem, and it's easy to attract good teachers. PTAs and school districts 
somehow raise money each year to pay for technology and other educational 
extras. 

"It is really not an incentive. It rewards (those that have) money," Dr. 
Aretha Pigford, a member of the S.C. Board of Education, said this week. 

"Given the fact that we have so little money, and we know where the 
problems are, why not put the money where the needs are?" Pigford asked. 

It's not that simple, however. 

"Right now, we have to deal with the legislation as it's written," said board 
chairman J. Alex Stanton IV. The Education Improvement Act of 1984 designed 
the Incentive Reward Program to give money to schools that are working well or 
showing improvement. 167 
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By the end of 1997, a commission appointed by the State Board of Education compiled 
and presented a set of 10 recommendations for the legislature to consider when creating 
the new accountability system. The Board preliminarily adopted some of the 
recommendations in 1997: 

Academic standards are considered a key part of the PASS Commission's recent 
233-page report, which offers 10 recommendations to state legislators who will 
soon draft school accountability bills. 

The board's preliminary approval of English/language arts, mathematics 
and science standards - developed through a blending of PASS Commission 
suggestions and curriculum frameworks from the state Department of Education - 
is the first step in what will likely be a busy 1998. 

The PASS Commission report calls for testing of all students at the end of 
every year in each core subject, while also testing them on national achievement 
tests. 

It recommends the adoption of specific standards that spell out what 
children need to know at each grade level. For schools that aren't performing, the 
PASS Commission says the state should intervene. 168 

1998-2003 

In April of 1998, a story reported on the debates between the legislature and 
members of the State Board of Education over the wording of the new educational 
standards: 

A disagreement over how education standards should be worded could render 

obsolete the new statewide exams students started field-testing last week. 
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State Superintendent Barbara Nielsen said Monday that a bill sponsored 
by Rep. Ronny Townsend would render useless years of work by the Department 
of Education to develop standards and a test to measure them. 

Frustrated that those expectations were written in language for educators, 
the Anderson Republican wants a House education panel today to endorse 
standards in everyday language. 169 

From 1999 to 2003, stories assumed one of three major themes: (a) Reporting on the 
educational policies in the state — stories that presented the debates and pros and cons of 
various accountability laws, (b) reporting on scores (R/s) — stories that documented the 
achievement performance of students on recent statewide assessments such as the 
PACT — and (c) Fegislative stories that report on voting decisions of the state governing 
body (F/v). 

When students’ PACT achievement scores were released the first time, many 
stories commented on how the scores should be used for accountability purposes. For 
example, some stories in documenting passing/failing rates discussed the pros and cons 
of retaining students if they failed the exam. In October of 1999 it was reported: 

South Carolina students soon will be held accountable for their scores on the 
Palmetto Achievement Challenge Test. If they don't pass the new, more rigorous 
test on state standards, they could be held back a grade. 

"Now is the time for students, parents and educators to work together to 
focus on having every student master the standards," state Education 
Superintendent Inez Tenenbaum said Wednesday as she released the first round of 
PACT scores. 
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About a third of the 330,000 public school students in grades three 
through eight who took the test last spring did not meet the state's basic math 
standards and almost half did not meet the English standards. 

The Education Accountability Act of 1998 says classroom grades, teacher 
judgment and PACT scores should be used to help make retention decisions. 
Local school boards determine the specific standards students must meet to 

170 

pass. 

Throughout 2000, there were several stories reporting on students’ updated PACT 
performance as well as recounting the type of consequences schools/districts and/or 
students faced as a result. In November of 2000, it was reported: 

The failures of grade schoolers may test the mettle of lawmakers to stand by the 
Education Accountability Act standards they have set. 

Up to a quarter of the state's fifth- through eighth-graders could be held 
back next year after failing at least one section of the Palmetto Achievement 
Challenge Test for the third time this spring, state officials estimate. 

Failure's price tag is high. The accountability act puts a financial burden 
on the state to help schools and students meet the standards. The state and local 
districts face the prospect of coming up with an extra $425 million to pay for 
more than 75,000 students to repeat a grade. In 1998, South Carolina schools 
retained 12,467 students. 171 

Another story in The Herald of Rock Hill South Carolina recounted how local students 
generally performed on the PACT : 
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Local students generally scored higher on the Palmetto Achievement Challenge 
Test this year than they did in 1999, the first year the state standardized test was 
given. 

PACT results, released Tuesday, show that school districts in York, 
Chester and Lancaster counties improved in virtually all categories. 

PACT was first given to third- through eighth-graders in 1999, replacing 
the Basic Skills Assessment Battery with a more challenging test to see whether 
students were performing at grade level. 

While some of the increases can be attributed to students and teachers 
being more familiar with the test, local districts hope to see students steadily 

172 

improve on the test. 

As time progressed, the stakes associated with PACT performance increased and 
numerous stories discussed how schools, parents, teachers, and students were preparing 
for the test and what they were doing to combat the anxiety and fear associated with the 
prospect of not passing the test. For example, in the spring of 2001, one story provided 
tips to parents for how to ready their child for PACT: 

The message from South Carolina educators as PACT week approaches is clear - 
get your children to bed early and feed him or her a good breakfast before sending 
them to class. 

As more than 300,000 third through eighth-graders take the Palmetto 
Achievement Challenge Test next week, anxious educators throughout the state 
have pressed the age-old advice in letters to parents. 
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The test scores will grade individual schools from excellent to 



unsatisfactory when the first report card is released in November. 

"There is a good reason why teachers are so nervous," said Patricia Burns, 
Lancaster County School district associate superintendent for instruction. "That 

1 7T 

single indicator carrying so much weight is what makes teachers so nervous." 

Similarly, with the passage of time, schools and districts amassed enough data to report 
trends in student performance. The state accountability system mandated that 
schools/districts be labeled according to absolute performance as well as improvement 
over time — labels which trigged any number of consequences including financial rewards 
for improvement, and school improvement status for schools/districts that continually 
failed to make progress. 

In 2002, a story discussed the problems the state was having with the testing 
company responsible for scoring PACT. The state complained that the testing company 
was releasing data with errors, and they were taking too long to release data. 

2004 

The primary story that emerged from a search of this time frame focused on high 
school graduation requirements and the testing standards that are set for high school 
seniors. 

Supplemental Search: Google 

A search was conducted on March 4, 2004, covering the previous 30 days. 

Several search terms were used to probe for the widest selection of stories. A selection of 
these stories is included in the portfolio. 
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Supplemental Search: LexisNexis 



A search of March 2003 through March 2004 was conducted looking for specific 
articles on consequences dolled out to students and/or school personnel in the form of 
rewards (incentives, bonuses) and sanctions (retention, school takeover). The search 174 
yielded 34 stories, of which nine were downloaded for more careful review. Another 

1 7S 

search was conducted specifically looking for stories covering the LIFE scholarship. 
Forty articles were found on this topic across the previous year and a selection of these 
stories was included in the portfolio. 

Tennessee 

A search 176 was conducted across the entire LexisNexis universe of news media 
available in Tennessee. This initial search returned more than 1,000 stories, and thus, 
adjustments were made to the search criteria. A second search was conducted using a 
search string that eliminated the words “test” and “assess,” and only stories containing 
the acronym TCAP — referring to Tennessee’s testing program entitled Tennessee 
Comprehensive Assessment Program — were selected. This produced 156 stories 
dating back to 1994, of which 69 were downloaded for further review and consideration. 

A follow up search was conducted looking for stories prior to 1994 and 
containing the words “test” and “assess” — the TCAP program was instituted in the late 
1990s. 179 This search yielded 29 articles, of which only four were remotely related to the 
issues of high-stakes testing and accountability. These four were downloaded for further 
consideration. 
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Content Analysis 



The number of stories that were reviewed based on year and primary content are 
presented in Table 14. A description of the primary themes of these stories across time is 
described next. 



Table 14: Story Tallies by Year and Category for Tennessee 



Year 


Number of 


Category* 


Number of Stories 


Stories 


per Category 


1994 


1 


R 


1 


1995 


7 


R/L/O 


4/2/1 


1996 


4 


R/L/O 


2/1/1 


1997 


4 


R/L/O 


2/1/1 


1998 


9 


R 


9 


1999 


3 


R 


3 


2000 


7 


R/O 


5/2 


2001 


8 


R/L 


6/2 


2002 


9 


R/L/O 


7/1/1 


2003 


15 


R/O/PI 


11/3/1 


2004 


2 


R 


2 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



1994-1999 

During this time period, the majority of the stories that were downloaded and 

subsequently included in the portfolio were “reporting” in nature, and they consisted of 

two main types — Reporting/Policy (R/p) and Reporting/Scores (R/s). Throughout the 

time period of 1994 - 1997, there were not many stories relevant to high-stakes testing in 

Tennessee. This trend mirrored the political climate of the time period. Tennessee was 
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just starting to develop an accountability system — the value-added system — and as more 
data became available with time, more stories emerged discussing and debating the 
merits of accountability and of holding educators accountable to the public. For example, 
in 1995, one “reporting” story discussed the merits of the value-added system. The 
article specifically described the growing number of complaints expressed by educators 
on holding them accountable based on test scores on a norm-referenced assessment 
system: 

The State Board of Education is re-evaluating its method of testing students to 
measure the performance of schools, because of complaints from teachers and 
parents. 

The Tennessee Comprehensive Assessment Program, currently mandated 
for grades 2-8, is a multiple-choice test used to determine school-by-school 
accountability numbers, called "value-added." These results make up the 21st 
Century Schools Report Card issued the past three years. 

"We're calling for a total re-evaluation of the testing program in grades K- 
12," said Charles Frazier, state board member. "It's an attempt to make certain 
that assessment is designed to improve student learning." 

Since it was started in 1990, a growing number of teachers have 
complained that TCAP tested their students on topics they weren't required to 
teach. 180 

Subsequently, Tennessee education policies were challenged — there were two editorials 
that argued for and against the TCAP as a tool for holding schools accountable: 
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Efforts to weaken Tennessee's testing program in public schools appear to be 
picking up more opposition than support, at least among legislators in this area. 
That is good. 

Senate Republican Leader Ben Atchley of Knoxville said last week he is 
bothered by reports that some lawmakers intend to propose changes in the 
program, called the value-added assessment system, which was designed by 
University of Tennessee statistician Dr. William Sanders. 

The testing program is a complex statistical system designed to measure 
the extent of student progress from year to year in five subjects: reading, language 
arts, math, science and social studies. It is based on the results of Tennessee 
Comprehensive Assessment Program (TCAP) tests administered each year in the 
second through eighth grades. 181 

By 1999, several stories had emerged that presented student test result data. For 
example, in 1998, the media presented the public with the most recent round of school 
labels: 

Report cards are out, and four Hamilton County schools have straight A's. 

Calvin Donaldson Elementary, McConnell Elementary, Ooltewah 
Intermediate and the 21st Century Preparatory School topped the list this year of 
county schools improving their academic performance faster than the national 
average, according to a comprehensive assessment of education in Tennessee that 
was released Monday. 

A number of other schools have made the A-B honor roll, and show signs 
of improving. 
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"I'm not disappointed in these results," Superintendent Jesse Register said 
when state Department of Education officials released the report cards Monday 

1 R? 

afternoon. 

And in 1999 the media presented specific grade-level TCAP performance results: 

Hamilton County Schools' student scores on 1998-'99 standardized tests may be 
"OK," but students in other parts of Tennessee did a little better. 

County students in grades 3-8 met or exceeded the national norm, 50 on a 
scale of 1-100, 68 percent of the time in the seven major test categories, including 
math and language arts. 

However, students in other parts of the state met or exceeded the norm 90 
percent of time in those categories, according to state records. 

Schools testing director Kirk Kelly called the county's current scores 

"OK." 

School officials said $8,000 worth of new, test- analyzing computer 
software will transform local students' scores into a detailed profile of student 
skills so teachers and administrators can address student weaknesses. 

The TCAP (Tennessee Comprehensive Assessment Program) achievement 
test is now called the TerraNova test by school officials. This new version of 

1 RT 

TCAP is in its second year of use in the county, Dr. Kelly said. 

2000-2004 

The first set of publicly released school-level report cards were released in 2000. 

Some articles predicted their local school’s report card would be negative as evidenced in 

this July 2000 Commercial Appeal headline: “City Schools Expect Poor Report Card: 
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I R4 

State To Issue Warning List On 48 Worst Performers.” This was followed by several 
stories commenting on report card results. In late July, it was proclaimed: “More than 
Half of Tennessee’s Troubled Schools in Memphis: State Requires 26 ‘Failures’ to 
Improve Substantially.” In November, it was announced that the state was going to 
release their first-ever school-by- school report cards: 

For the first time, the Tennessee Department of Education has released 
performance data for all 1,61 1 schools in the state. 

The Report Card 2000 is a broad look at how well students scored on 
Tennessee Comprehensive Assessment Program (TCAP) standardized tests, and 
how much they learned over the course of the previous year. 

While the department has released report cards on school systems for the 
last seven years, this is the first to grade individual schools. 186 

And, in 2001, several stories commenting on local school successes and failures 
emerged, like the one appearing on March 11, 2001, in the Chattanooga Times Free 

1 07 

Press with the headline: “Hamilton schools in top 20 ranking,” and the one appearing 
on September 22, 2001, in the Commercial Appeal announcing: “6 city schools rejoice at 

1 QO 

‘movin’ on up’ from state risk list.” 

In 2002, a series of stories covered the debate over the exit examination. 

Specifically, questions emerged discussing when the new exit exam should be instituted 

and whether it is prudent to base graduation decisions on a test. And, in 2003, many of 

the stories commented on a scandal involving teachers who allegedly helped students 

“too much” on their standardized test. Perhaps as a result of this incident, editorials and 

personal interest stories converged on the topic of whether the pressures of TCAP were 
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too much. For example, a personal-interest story appearing in September of 2003 



describes how a veteran teacher feels too much pressure to focus on testing: 

Cathy Branan's third-grade class doesn't begin with hugs and story time. 

It begins with "morning meeting" - a 15-minute session where children put 
their ponytailed and cornrowed heads together to focus on the day's TCAP 
objectives. 

If that sounds like a somber way to begin the day for 8-and 9-year-olds, 
consider this - the fate of their school hinges on these kids' performance on the 
Tennessee Comprehensive Assessment Program (TCAP). 

Teaching has changed in the 34 years Branan's been in the profession. 
Decades ago, when she started out, she was master of her lesson plans. 
Now, TCAP objectives drive what she teaches in class. 

"It's not right. It's not fair. But it's all down to test scores," Branan, 54, 

says. 

What she calls her teaching "bible" includes binders that map out what 
kinds of questions have appeared on the TCAP over the last three years and how 
frequently each question has appeared. 

These binders prescribe her focus in class. For example, since identifying 
subject and predicate in sentences has appeared four times on recent TCAPs, 
Branan will spend a week covering it. On the other hand, she may spend only a 
day covering combining sentences, since recent tests have had only one question, 
or none at all, in that area. 
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Slowly and steadily the stress of high-stakes testing is getting to her, even 



though she's among the most experienced and celebrated teachers in Memphis 
City Schools. 189 

Supplemental Search: Google 

A search was conducted on March 4, 2004, covering the previous 30 days. 

Several search terms were used to probe for the widest selection of stories. A selection of 
these stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A search of stories from March 2003 through March 2004 was conducted. This 
search focused on specific articles that described consequences dolled out to students 
and/or school personnel in the form of rewards (incentives, bonuses) and sanctions 
(retention, school takeover). The search 190 yielded 33 stories, of which eight were 
downloaded for more careful review. 

Texas 

Two searches 191 using LexisNexis 192 were conducted to look for high-stakes 
stories in the state of Texas. These two searches were conducted in an effort to look for 
stories related to the two main assessment systems that were used in Texas. The first, 
major assessment system was the TAAS — first given in 1990. This initial search 
covering the entire universe of stories available on LexisNexis returned 75 hits dating 
back to 1995. After duplicate and irrelevant stories were eliminated, a total of 66 stories 
were downloaded for more careful review and coding. A tally of the number of stories 
found by year and category is presented in Table 15. 
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Table 15: Story Tallies by Year and Category for Texas 



Year 


Number of Stories 


Category* 


Number of Stories 
per Category 


1995 


1 


R 


1 


1996 


1 


R 


1 


1997 


2 


R/L 


1/1 


1998 


6 


R/L/O 


4/1/1 


1999 


17 


R/L/O 


6/5/6 


2000 


15 


R/L/O/PI 


6/3/5/ 1 


2001 


8 


R/L/O/PI 


4/1/1/2 


2002 


8 


R/L/O 


3/2/3 


2003 


8 


R/O/PI 


5/1/2 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (Refer to legislative voting and/or actual decisions as well as legal concerns that are 
brought to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial 
columns); and PI=personal interest (these stories focus on specific individuals and their experiences in 
high-stakes environment). 



Content Analysis 

Across this time period there were a total of 31 stories representing the 
“reporting” category and included stories that reported on student achievement trends 
and/or scores, policy debates, and research results. Many of the “reporting stories” were 
neutral in tone and simply supplied documentation to the public concerning the 
percentages of students that passed or did not pass aspects of the TAAS. Some stories 
were positive, like the one on May 21, 2002, with the headline, “Passing rate for TAAS 
creeps to 82 percent statewide: Education chief says ‘We’re not there yet’ after 18 
percent fail one or more sections of the exam.” 

There were 13 stories discussing legislative decisions and/or legislative concerns. 
For example, several stories discussed the merits of the policy that seemed to be unfair to 
minority students. These stories mostly presented an argument that the policy was unfair. 
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But one story discussed both sides of the argument. In this article (on September 19, 



1999, and presented in San Antonio Express-News ), the writer explores a lawsuit brought 
“on behalf of nine African-American and Mexican- American students.” The article goes 
on to say that the lawsuit is significant, “because it'll open the state's highly lauded school 
accountability system to public scrutiny and could agitate the ongoing national debate 
about standardized testing's fairness. It targets the state, the Texas Education Agency and 
the State Board of Education.” However, although the person who brought the lawsuit is 
considered, “a champion of the Mexican- American community who's left his imprint on 
Texas history,” there are some, even minorities, who “straddle the fence or even disagree 
outright” with his court challenge. This story provided a balanced account of this debate. 

Within the “legislative” category, story theme became evident simply commented 
on changes in state policy. For example, on May 15, 2002, a story appeared from the 
Associated Press discussing a proposal that would allow schools more flexibility in how 
they administer the TAAS. In spite of this more neutral story, however, the bulk of the 
legislative stories throughout this time period, confined to this specific search, were 
negatively skewed against the use of tests for awarding a diploma in Texas because, the 
stories say, they unfairly punish minority stories. 

There were 17 opinion- and reaction-oriented stories. Stories in this category 
were either editorials where readers wrote in their comments, concerns, or perspectives 
on high-stakes testing and/or the state’s assessment system. The bulk of these stories 
were negatively skewed. However, one was somewhat neutral, presenting the positive 
and negative effects of the state’s exit exam. On November 9, 1999, readers shared their 
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views of using the TAAS as a high school exit exam after many of them actually took the 



Some found it surprisingly simple. Others thought the test was a good gauge of 
the minimum skills students need in the real world. A few found fault with the 
high-stakes nature of the exam, while others lauded it for pushing educators to 
ensure all students were learning. 

Many who took the math test two weeks ago discovered six problems had 
typographical errors or missing information making the questions impossible to 
solve. That was our fault, and although we published the corrected versions of 
those problems last week, we agreed with readers who gave us a failing grade for 
not getting it right the first time. 

After taking the test, many readers logged onto the Internet and posted 
messages on our chat forum. Here's what some of them had to say. 

“Dumbing down” 

Although the math test seeks to ensure that all students have a minimum 
skill level in select, functional math areas, it doesn't touch on some basic skills, 
such as converting units of measure (cups in a quart, etc.). The goal is admirable; 
however, exit tests such as the TAAS, have a tendency to "dumb down" a 
student's education, as teachers "teach to the test." 

“Creating losers” 

Could you tell a mother who has a 17-year-old boy you would deny him a 
diploma when you personally know the boy is sincere, did his best, went through 
the system for 13 years but did not pass the math test? 
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He did not get a diploma and he did not walk the stage with his peers. He 



never took honor classes because he did not have college as his goal. Why would 
you want to deny him the diploma? To see a mother's tears? 

If the STATE mandates a test, then it needs to provide all the classes to 
pass this test. The state nor the school district does this equally. Furthermore, it 
does not have the budget for really good teachers and small honors classes. 194 

Lastly, there were five “personal interest” stories where local residents shared 
their personal experiences with and/or perspectives on the high-stakes testing 
accountability system. For example, on May 30, 2001, a story focused on how a high 
school senior prepared to take the exit exam: 

Chris Rincon started the school year with a pledge. 

"I'm going to get a tattoo that says I passed the TAAS," said Rincon, an 
18-year-old senior at Holmes High School. 

But before he could go under the needle, Rincon had to pass the Texas 
Assessment of Academic Skills, or TAAS, the state-mandated exam that all 
public high school students must master to graduate. 

So Rincon found himself in Mina Stecklein's second-period English class 
with 16 other seniors who had failed some part of the reading, writing and math 
test their sophomore or junior year. 

To help them get their diplomas, the school placed the seniors in 
Stecklein's care in another attempt to adequately prepare them for the exit-level 
TAAS. 195 
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A second search was done using the same search string, but replacing TAAS with 



TAKS (the new assessment). This search was restricted to the last year of articles only 
and yielded 10 hits. After redundant and irrelevant articles were eliminated, only three 
were downloaded for careful review. Instead of cataloging these stories, all of them were 
included in the portfolio. 

Supplemental Search: Google 

A search was conducted on January 26, 2004, covering the previous 30 days, that 
yielded about 20 stories. Four of these stories are included to represent the major debates 
during the time: the implementation of Texas’ new TAKS assessment program as well as 
a debate on the issue of merit pay for teachers. 

Supplemental Search: LexisNexis 

Several searches using LexisNexis were conducted to look explicitly for 
consequence-based stories. The first search looked explicitly for sanctions applied to 
school and/or teachers; 196 it yielded 144 hits. After redundant and irrelevant articles were 
eliminated, a total of 13 stories were downloaded for more careful review. Of these 13 
stories, only two were included in the portfolio. One focused on a bill that would allow 
teachers to be fired more easily and one that discussed the plight of a teenage mother and 
the challenges of going to school under No Child Left Behind. The remaining 1 1 stories 
were not useful or relevant. A second search was conducted looking more explicitly 

1 no 

for reward-oriented occurrences. This search yielded 33 hits. A selection of these is 
included in the portfolio. 
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Utah 



A search 199 was conducted across the entire LexisNexis universe of news media 
available in Utah. 200 This initial search, extending across the entire universe of news 
articles, returned 682 stories dating back to February 1994. Irrelevant and duplicate 
stories were eliminated, leaving 94 that were downloaded for more careful review and 
consideration. 

Content Analysis 

The numbers of stories that were reviewed based on year and primary content are 
presented in Table 16. A description of the primary themes of these stories across time is 
described next. 



Table 16: 


Story Tallies by Year and Category for Utah 


Year 


Number of Stories 


Category* 


Number of Stories 
per Category 


1994 


1 


R 


1 


1995 


1 


R 


1 


1996 


3 


R 


3 


1997 


4 


R/O 


3/1 


1998 


5 


R 


5 


1999 


21 


R/L/O 


8/12/1 


2000 


11 


R/L/O 


4/4/3 


2001 


11 


R/L/O/PI 


5/2/3/ 1 


2002 


12 


R/O 


10/2 


2003 


19 


R/L/O 


13/4/2 


2004 


3 


R/L 


1/2 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); Legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and PI=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 
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1994-1999 



The first article downloaded and appearing in 1994 laid the groundwork for the 
sets of issues that would be discussed in Utah. In 1994, the Salt Lake Tribune reported 
on the most recent round of test scores while describing the current state laws around 
academic assessment: 

Another drop in the fifth-grade reading score is the dark cloud hanging over an 
otherwise positive showing by students in Utah's 1994 statewide testing program. 

It is the second time in four years that the reading score at the fifth-grade 
level has declined. The long-term ramifications of the trend has educators 
worried. 

State law requires students in grades five, eight and 1 1 to take a norm- 
referenced test each fall as a way of making schools more accountable. In the 
next few weeks, test results for all 40 districts and individual schools will be 
reported to the public. 

In 1994, the fifth year the statewide test has been given, some 98,880 
students in the three grades participated. Students were tested in late September 
and early October in all major subjects, including math, reading, English, science, 
social science and a total basic battery. 201 

Importantly, as is stated in this article, state law has required students in grades 5, 8, and 

1 1 to take a norm referenced test since 1989. 

There were few articles throughout the next few years that added anything 

substantive to Utah’s accountability system. Importantly, those that were most relevant 

included an article outlining a candidate for governor’s position on a variety of topics, 
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including education, and other reports documenting trends in student achievement. In 
1999 there was a surge of media documentation on what was going on in Utah with 
respect to educational accountability. For example, a story reported in the Deseret News 
(A Salt Lake City publication) in January of 1999 discussed research reported on by a 
local professor — arguing that for Utah’s students to become more competitive nationally, 
Utah would need to establish a meaningful accountability measure: 

Utah's schools are hindered by the lack of a statewide accountability plan 
outlining consequences for failing to meet specific academic standards, according 
to a recent report by a University of Utah education professor. 

John Bennion, clinical professor at the U.'s graduate school of education, 
says in a policy brief for the school's Utah Education Policy Center that officials 
need to see the importance of setting high standards and aligning core curriculum 
to a year-end assessment of what students have learned. 

Steps to help low-scoring schools — and consequences for continued poor 
performances — also need to be established for educators, he said. 

"Until those elements are in place, no meaningful accountability will exist 
in Utah schools and new and existing programs will continue to operate without a 
clear vision of the desired learning goals to be achieved," said Bennion, a former 
Salt Lake City School District superintendent.' 

After this report, but not necessarily in response to the report, a series of articles 
emerged across varying publications arguing the need for increased accountability in 
Utah. Many believed that teachers should be held accountable. One story recounted the 
most recent round of legislative proposals that were being debated by policy makers: 
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In the wake of slipping reading test scores, the Utah Legislature debated a handful 



of bills to hold teachers accountable for test results. 

A bill by Rep. Sheryl Allen, R-Bountiful, considered a big victory by the 
State Office of Education, aims to tighten teacher licensure standards and includes 
provisions for testing teachers' skills before they enter the classroom. 

"This isn't teacher bashing," said Rep. Keele Johnson, R-Blanding, whose 
bill hashing out rules of proposed teacher testing never made it out of Senate 
rules. 

Allen's bill also creates national board certification as a top licensure goal, 
but tests cost $2,000 apiece. 203 

And, at least one editorial writer argued support for this type of accountability: 

Accountability is a vital part of education. Homework, tests and various other 
measuring sticks provide it for students. 

But what about those who instruct the students — the teachers? Shouldn't 
they also be accountable? Absolutely. 

How to have teachers demonstrate that accountability has proven to be a 
philosophical beach ball — it keeps getting batted around but never seems to land. 

That may be changing in Utah, thanks in part to a bill unanimously 
endorsed by the House Education Standing Committee. The goal of the measure - 
- sponsored by Rep. Keele Johnson, R-Blanding and endorsed by both the State 
Office of Education and the Utah Education Association — is to ensure a qualified 
professional in every classroom. 204 



Page 297 of 336 

This document is available on the Education Policy Studies Laboratory website at: 

http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0509-105-EPRU.pdf 





Throughout 1999, Utah batted around a series of legislative ideas and the press 



recounted the surrounding debates. Importantly, different groups of individuals had a 
different perspective on the variety of legislative proposals that were being considered. 
For example, one proposal was to hold schools accountable for increasing student test 
scores — in this case, accountability meant public grading of each school based on how 
they performed (e.g., on a scale of A to F). Some educators vehemently opposed such an 
idea as was reported in October of 1999: 

Educators give an "A" to setting high standards and being held accountable. 

But rating schools on how well kids do on a battery of standardized tests receives 
an "F." 

That's the report card heard Wednesday from 50 people addressing the 
State Task Force on Learning Standards and Accountability, who agreed that 
money for a massive accountability model would be better spent on programs, 
supplies or teacher salaries. They want parents, students and the Legislature to be 
held accountable, too. 

"You need to quit threatening us," said Deanna Johnson, a Jordan District 
educator. "I would never tell a doctor or lawyer how to run his practice. You 
need to come spend more time in the classroom." 

Speakers in the audience of 200 or more, mostly educators from Murray, 
Jordan, Granite and Uintah school districts, seemed to drive home their point with 
a hammer. 205 
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2000-2002 



Debates around accountability continued, and articles and editorials that discussed 
both sides of the issues continued to appear. For example, some were supportive of 
holding educators accountable for test performance: 

Sadly, the idea of rewarding and punishing employees for performance is resisted 
at every turn in the public school system. In private business it is a bedrock 
principle that keeps corporations competitive. But educators believe it is too risky 
to hold people accountable for the way others perform. It may be OK for coaches 
to be expected to win even though their success depends on others, but not 
teachers or administrators. That is why programs like those sponsored by 
Eccles/Annenberg, although effective, aren't likely to lead to any long-term 
results after the money is gone. 206 

In another opinion piece, one writer in September 2000 also supported the idea of grading 
schools based on how well they are teaching their students: 

If a school is doing well, the public has a right to know that and to specifically 
understand if it is performing at an "A", "B" or other level, using a scale that is 
easily understandable and comparable. More importantly, the public needs to 
know which schools fail to teach adequately, and these should be labeled as such. 
Obviously, schools with poor grades or rankings would suffer some 
embarrassment, but they would then take steps to improve, as failing schools have 
in other states with grading scales. How schools perform is something that should 
be measurable on a yearly basis and put in terms easy to interpret. Grading, as 
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opposed to listing results in confusing categories, would allow the public to track 



a school's progress. 207 

All of these debates were in reaction to a house accountability bill that was passed in the 
spring of 2000. The Bill was described in the Deseret News in March of 2000: 

The Legislature approved a bill laying the groundwork for greater school 
accountability but not before slashing the proposal's funding in half. 

HB177, sponsored by Tammy Rowan, R-Orem, creates the Utah 
Performance Assessment System for Students (U-PASS). 

U-PASS will include new writing exams for sixth- and ninth-graders and 
short-answer tests, plus the Stanford Achievement Test, core curriculum test and 
upcoming lOth-grade basic skills test already in state law. All will be phased in 
by the 2004-05 school year. 

The bill also directs an accountability task force, which has met since May 
to come up with the bill, to determine what other data might be publicly reported 
as accountability measures. The aim is to identify struggling schools needing 

90R 

additional resources or reward others for excellence.” 

Throughout 2001 and 2002 stories on accountability, the pros and cons, 
continued. However, more stories appeared discussing how students were doing on the 
new assessment system. Similarly, many stories discussed how Utah’s pre-existing 
accountability system would mesh with NCLB. A cross section of these stories and 
issues is included in the portfolio. 
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2003-2004 



Throughout 2003, the main theme appearing in the news had to do with the exit 
test. Some questioned whether it was a good measure of student knowledge. Others 
argued that special population students were having difficulties on the test. And still 
others believed that Utah gave simply too many tests. The exit test was piloted in the 
spring of 2003: 

Utah high school students this week will either put their feet up — or into the fire. 
Tuesday through Thursday, sophomores will pilot a controversial graduation test 
that soon will determine whether students receive a high school diploma. 

The test doesn't count for them. 

But school bosses say there's a big reason to take the Utah Basic Skills 
Competency Test seriously. And some even are having juniors and seniors leave 
early or start later on those days to create a serious, highly supervised testing 
atmosphere for the sophomores. 

"It's mainly to make sure we're focusing on the test and make sure there 
are no distractions," Davis District director of research and assessment Chris 
Wahlquist said. "We think it's important." 209 

Controversy was ever present following the first administration of the exit test primarily 
because educators complained students simply had not been exposed to the standards- 
based curriculum (on which the test was based) long enough. In June of 2003, the 
Deseret Morning News reported on this issue: 
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The UBSCT is required for students to earn a full diploma, with those failing the 
test receiving alternative diplomas. Its purpose is to give a high school diploma 
more substance. The class of 2006 was to be the first to be tested. 

The UBSCT is being considered for elimination because proposed 
standards-based graduation requirements would accomplish UBSCT's goals, said 
state Testing Coordinator Louise Moulding. 

The proposed graduation requirements are in response to SB 154 and 
complaints from the governor's Employers Education Coalition that high school 

9 1 0 

graduates are ill-prepared for the work force and lack basic knowledge.” 

A follow-up article in February of 2004 extended on these initial concerns when the test 
was given for the first time and passing it was a requirement for graduation: 

Ask high school sophomores about this week's basic skills exam and they shrug it 
off as one more in a series of standardized tests to suffer through — and an 
unnecessary one at that. 

"It's kind of stupid because we're being tested in all our other classes, and 
if we're passing those tests, obviously we know how to do it," said Rachel Evans, 
a sophomore at Viewmont High in Bountiful. "If our teachers pass us, and we 
pass all our classes, we should be able to get our diploma rather than it being 
based on one test." 

Therein lies the difference between this and other exams. 

For the first time in its three-year history, the Utah Basic Skills 
Competency Test counts toward graduation. It measures students' grasp of core 
curriculum standards through 10th grade. Students in the class of 2006 and 
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beyond must pass the exam to earn a high school diploma, even if they satisfy all 
other graduation requirements. 

So not everyone understands the stakes attached to the test, affectionately 
known as "U-biscuit." 

The test was given on a pilot basis the past two years, so it didn't count for 
the students who took it. In addition, funding shortfalls and priority shifts at the 
Legislature put the exam in an on-again-off-again mode, which has left some 
students and parents in the dark about its current status. 211 

Supplemental Search: Google 

A search was conducted on April 6, 2004, covering the previous 30 days. Several 
search terms were used to probe for the widest selection of stories. A selection of these 
stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A search of April 2003 through April 2004 was conducted, looking for specific 
articles on consequences dolled out to students and/or school personnel in the form of 
rewards (incentives, bonuses) ” and sanctions (retention, school takeover). The search 
for positive consequences yielded four stories and the search for negative consequences 
yielded ten stories. A cross section from both of these searches was downloaded and 
selected for portfolio inclusion. 

Virginia 

214 

A search” was conducted across the entire LexisNexis universe of news media 

available in Virginia.” This initial search, extending across the entire universe of news 

articles returned more than 1,000 stories, and thus, adjustments had to be made in order to 
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reduce the number of stories to a manageable set. A second search was conducted and 
confined to the time period of January 1, 1994, to December 31, 1996 (there were no 
stories prior to 1994). This search yielded 314 stories, of which 75 were downloaded for 
more careful review and consideration. The next search 216 extended January 1, 1997, to 
December 31, 1999, and produced 193 stories, of which 42 were downloaded for review. 
A final search was conducted across January 1, 2000, to March 5, 2004, and yielded 
266 stories, of which 54 were downloaded for review. 

Content Analysis 

The numbers of stories that were reviewed based on year and primary content are 
presented in Table 17. A description of the primary themes of these stories across time is 



described next. 

Table 17: Story Tallies by Year and Category for Virginia 



Year 


Number of Stories 


Category* 


Number of Stories 
per Category 


1994 


6 


R/L/O 


4/1/1 


1995 


18 


R/L/O 


11/5/2 


1996 


21 


R/L/O/PI 


8/6/6/ 1 


1997 


2 


L 


2 


1998 


5 


R 


5 


1999 


16 


R/L/O 


7/3/6 


2000 


10 


R/L/O/PI 


7/1/1/1 


2001 


9 


R/L/O/PI 


4/2/2/ 1 


2002 


5 


R/L/O 


3/1/1 


2003 


10 


R/O 


8/2 


2004 


3 


R/L 


2/1 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 
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1990-1996 

There were no stories prior to 1994, so a description of the major themes during 
this time is confined to 1994-1996. Most stories could be characterized by a “reporting” 
theme. During this time, Virginia began public dialogue on the merits of increased 
accountability in the state. Articles debated the current assessment system, how it might 
be changed, and in what ways assessment results would be used to hold schools 
accountability. For example, in 1995 there was a story discussing the need for increasing 
the state’s academic standards for improving student performance: 

The academic performance of Virginia’s public school students has grown 
stagnant, making it clear that the state needs improved standards of learning, state 
schools Superintendent William C. Bosher Jr. said Wednesday. 

“We need to give kids better academic targets to shoot for,” Bosher said at 
a news conference after releasing results of the 1993-94 “report card” of the 
state’s schools. 218 

Stories emerged following this call for higher standards debating the merits of the 
administration’s proposal, highlighting the advantages and disadvantages embedded in 
such a proposal: 

A yearlong push by the Allen administration to create new academic standards for 
Virginia’s public schools is creating high anxiety among the state’s education 
community and many parents. 

Fundamental differences exist over proposed changes that, in some cases, 
would radically alter what children are taught in four essential subjects - social 
studies, language arts, math and science. 
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Today, the state Board of Education, which has the final stamp of 
approval, begins a statewide series of open hearings on the proposal at 7 p.m. at 
Maury High School in Norfolk. The board can expect an earful. 

Some worry that the state is trying to move too fast on a plan that will 
have long-lasting effects. Others contend that the effort is more reflective of a 
narrow political agenda than sound teaching practices. And many fear that in the 
rush for higher standards, the state may be creating unrealistic expectations that 
will set up some children for failure. 219 

It was during this time period that the notion of attaching consequences to student 
performance was introduced into public debate. 

Over time there were a growing number of opinion pieces speaking to the merits 
of instituting a new statewide testing program to measure the increased standards. Many 
of these appeared in 1996. These articles commented on both sides of the debate. One 
writer took a stance against testing because the writer feared it would be under funded 
and teachers would become the scapegoats: 

Our leaders are willing to fund one area of the standards: testing for them. They 
will supply no materials or textbooks, but want to test the students’ learning and 
hold teachers and schools accountable. Isn’t this putting the cart before the horse? 

Yes, give teachers the bad rap for not wanting to change. I’d rather take 
that than accept bad decisions forced upon us and our students. Why don’t 
leaders help us to teach children rather than hindering us? 

Another was for the testing proposals: 
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Although Governor Allen’s proposal to test Virginia schoolchildren’s 
achievement in basic academic subjects continues to meet resistance, its critics 
have yet to present a defensible argument — perhaps because none exists. Why 
shouldn’t Virginians know whether students are learning what they are 
supposedly being taught? As the Governor pointed out recently, testing is nothing 

more than a consumer protection plan: Taxpayers and parents have a right to 

221 

know if their money is serving its purpose . 

Other stories during this time were “legislative” in theme and reported the 
legislative proposals and voting patterns around the proposed standards increase. 

1997-1999 

During this time frame, articles focused on the new testing system, the Standards 
of Learning (SOL). “Reporting” themed articles debated the use of SOL for holding 
schools and students accountable. For example, one article appearing in 1999 presented 
both sides of the debate: 

Furor over Virginia’s new Standards of Learning seems not to have diminished 

with the approaching end of another school year. In public hearings around the 

state, critics worry that standardized tests are sucking flexibility and creativity out 

of classrooms. Advocates counter that the only way to improve quality is to set a 

baseline and test to see if progress is being made. In truth, merit and misguided 

thinking inhabit both sides of the debate. Prospects for real reform will require 

understanding that the SOL tests are both necessary and not enough. 

Minimum learning standards are needed, among other reasons, to help 

protect children from inferior schools and teachers, of which Virginia has 
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multitudes. An overemphasis on test-taking, however, promotes dullness and 
rigidity. Pity students trapped in schools more intent on transmitting test answers 
than on encouraging the thirst for learning. 

Conversely, “flexibility” in the classroom is fuel for inspired innovation 
and creative learning. Yet a lack of clear expectations or accountability for results 
can become, particularly in the wrong hands, a license for mediocrity or worse. It 

has become so too often in Virginia, especially in schools serving economically 

222 

disadvantaged communities." 

There were also “legislative” themed articles that documented the legislative 
initiatives and voting patterns in the state such as an article from 1999 where the 
governor proposed a pay-for-performance plan: 

The governor balked Monday at approving a General Assembly bill that would 
grant up to $ 30,000 over 10 years to teachers who gain national certification from 
the National Board for Professional Teaching Standards. 

Instead, he amended the law to instruct Virginia’s Board of Education to 
additionally tie the bonuses to producing “improvement in student academic 
achievement outcomes.” He suggested using scores on the state’s new Standards 
of Learning tests, improvements in those scores, and “successful remediation” of 
students who fail the tests. The General Assembly must rule on the changes by 
April 7. 223 

2000-2004 

Most of the stories encountered during this time frame were categorized as 

“reporting.” One theme common across all years were debates and decisions around 
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what the graduation requirements would be for high school students. These debates often 



sparked opinion pieces of individuals arguing whether using SOL scores are a good way 
to decide whether students should receive a diploma. There were several stories 
reporting on how to address special student populations such as students with disabilities 
and students for whom English is a second language. 

A selection of stories is included in the portfolio that represents the range of 
issues across all of these time frames and categories. 

Supplemental Search: Google 

A search was conducted on March 4, 2004, covering the previous 30 days. 

Several search terms were used to probe for the widest selection of stories. A selection of 
these stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A search confined to March 2003 through March 2004 was conducted looking for 
specific articles on consequences dolled out to students and/or school personnel in the 
form of rewards (incentives, bonuses) and sanctions (retention, school takeover). The 
search - yielded 122 stories, of which 20 were downloaded for more careful review. 

West Virginia 

A search was conducted across the entire LexisNexis - universe of news media 
available in West Virginia. 226 This search returned 566 stories dating back to 1994. 

After redundant and irrelevant stories were eliminated, 74 were downloaded for closer 
review and possible selection for portfolio inclusion. 
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Content Analysis 



The numbers of stories that were reviewed based on year and primary content are 
presented in Table 18. A description of the primary themes of these stories across time is 
described next. 



Table 18: Story Tallies by Year and Category for West Virginia 



Year 


Number of Stories 


Category 


Number of Stories 
per Category 


1995 


2 


R/L 


1/1 


1996 


1 


R 


1 


1997 


4 


R/L/O 


1/1/2 


1998 


0 


None 


0 


1999 


7 


R 


7 


2000 


2 


R/PI 


1/1 


2001 


11 


R/L/O 


6/2/3 


2002 


9 


R 


9 


2003 


30 


R/L/O 


23/1/6 


2004 


8 


R/L/O 


2/5/1 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L=legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and Pl=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



1995-1999 

West Virginia has had an educational accountability system dating back to at least 
the early 1990s as evidenced by stories reporting on school-level labels and the 
consequences that were applied. In 1995, an article appeared debating the merits of the 
Comprehensive Test of Basic Skills and the fallout of consequences to schools based on 
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CTBS performance. The article outlines many of the main arguments at the time around 
consequences and stakes associated with testing: 

Chandler students have tested below the 30th percentile on the Comprehensive 
Test of Basic Skills for the past three years, so the state education department 
labeled the school as "seriously impaired." State officials will check in with 
Principal Jane Harbert every two months until test scores improve. 

Drop-outs, attendance and CTBS scores are the only factors used by the 
state, and, for the most part, by the public to judge schools. State officials give 
systems approval or probation, just as home buyers ask for published test scores 
before they decide where to look for a house. Facing low scores, some school 
systems simply teach the test. Tyler County teachers, whose students scored 
highest in the state on the CTBS last year, pore over test results item by item, said 
Superintendent Sandra Weese. Any problem areas get special concentration next 
year. 

By comparison, the state put Kanawha County on probation after 18 of its 
schools tested below the 50th percentile. Administrators reluctantly told teachers 

227 

to start aligning their curriculums to CTBS items as well. - 

As West Virginia’s accountability system evolved, so did its standards and 
assessment. In 1996 the CTBS was abandoned for the SAT9. However, overtime, the 
SAT9 also encountered some controversy and many believed that it was unfair to make 
judgments about schools based on a test that did not necessarily cover what was being 
taught in the classroom. Gradually, the state adopted a set of state standards and 
eventually created a test to measure progress toward meeting the standards. 
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1999-2001 



Many articles throughout 1999 - 2001 recounted some of the ongoing debates 
around how best to assess student achievement and reward/sanction based on it. For 
example, in January of 2001, a “pro” testing editorial appeared in the Charleston Daily 
Mail: 

Testing is necessary and appropriate. The state has to know if its public schools 
are giving children the basic skills needed to function in the world. Parents need 
to know that. Students need to know that. 

Schools can't fix what they don't diagnose. Teachers can't either. 

West Virginia must maintain comparability. Its achievement tests must 
allow it to compare its results with results in other states. 

We need to know whether our children comprehend what they read as well 
as their cousins in North Carolina. We need to know if they have conquered the 
same basic math skills. They will have to compete in the same working world. 

But testing should not eat up weeks of an already skimpy school calendar. And 
certainly the state should be cautious not to micromanage the curriculum to the 
point that it discourages good teaching. 

West Virginia must test to see if its children are learning to read and write 

and calculate and understand. Devoting more class time to it and suspending the 

228 

thought processes of good teachers does not further that cause." 

As accountability associated with testing continued, however, reports emerged recounting 
the pressures teachers and students were feeling. For example, a story in December 2002 
said: 
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As 16 third-graders discussed what they had just read, their teacher asked them to 
name times they had been as afraid as a character in the story. 

"When I had to get stitches in my chin," one said. "When my grandma got 
two tumors in her head," said another. "When I was in the hospital to see if my 
mom was dead or alive," said a third. 

Then a boy said, "When we had the SAT 9 test." Heads around the room 
bobbed in agreement. 

Peterstown Elementary students who took the Stanford Achievement Test 
Ninth Edition (SAT-9) last spring were under tremendous pressure to prove their 
school was not "seriously impaired," as state officials had labeled it. 

Such pressures are only going to increase as the state launches a host of 
new tests next year and the federal No Child Left Behind act holds the nation's 
schools more accountable for results." 

2002-2004 

Throughout 2003 and 2004, the debate on accountability continued in West 
Virginia, as did reporting on how the assessment system was going to change. Accounts 
emerged as the accountability pressure was perceived to be increasing. According to one 
April 2003 story: 

Just about everything that means anything in West Virginia public schools 
depends on what happens next week. 

It's standardized testing time - the week thousands of third- through 11th- 
graders are expected to show everything they've ever learned by bubbling in tiny 
circles with a No. 2 pencil. 
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And if they don't know enough, schools can be placed on probation, 
penalized by the county, taken over by the state. Even lower property values in 
schools' neighborhoods can be a result. 

But this year, the stakes are even higher. 

This year, the new No Child Left Behind act takes effect. 

"Believe me, we are feeling the pressure," said John Handley, principal of 
Weimer Elementary in St. Albans. "Even our students know how important this 
is." 

Under the sweeping education reform law passed last year by Congress, 
schools face even tougher sanctions if all groups of students - based on gender, 
race, family income, English proficiency, disability and migrant status - don't 
meet high standards. 

Schools could have to pay for students to transfer to a better school, hire 
outside tutoring services, have entire staff replaced or even be taken over by a 
private company. 

The new law has caused tensions to run high in nearly every classroom 
across the state, as students gear up to take the SAT-9, the test that much of the 
implementation of the law will be based on. 

Further, policy reporting emerged discussing how the assessment system was 
going to change in the state. Instead of relying on students’ SAT 9 performance, students 
would be taking the new criterion-referenced WESTEST examination results of which 
will be used to continue the school-labeling system. 
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Another issue was how NCLB and West Virginia’s state accountability laws 



helped or hindered students from special populations such as those with disabilities. As 
this issue emerged on the national scene, two editorials appeared in West Virginia 
arguing both sides of the debate. One argued that requiring students with disabilities to 
take the test (such as what is required in NCLB) is a positive step toward helping those 
students feel “normal” and requiring teachers to hold higher expectations for them: 

Why aren't children with disabilities learning basic skills? From my vantage 
point as an advocate for children with disabilities, I have seen time and time again 
that school systems simply ignore the fact that children in segregated special- 
education classrooms are not learning to read or do math. Minuscule progress is 
cited to "pat everyone on the back," and then baby-sitting continues until the child 
becomes so bored and frustrated that he or she no longer wants to attend school. 
Then, when the child is made to attend, under pain of truancy, the child becomes a 
"behavior problem." 

These "behavior problems" are, in fact, usually directly related to feeling 
"dumb" and "out of it" because the child can't read well enough to keep up. This 
is a very convenient time for the system to "blame the child." 

No Child Left Behind will short-circuit all of the excuses and 
explanations. School systems that do a good job with children with disabilities 
will show their progress, and those that fail to do a good job will have their 
ineffectiveness exposed. Then parents and voters can make informed decisions 

oo 1 

about how to get the underachievers on track. 
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In contrast, another editorial writer complained that NCLB was too restrictive and 
damaging: 

Public education is at a crossroads. Despite the uplifting title of the No Child Left 
Behind Act of 2001, the law has created significant obstacles to helping students 
learn, which ultimately weakens our public schools. It imposes mandates without 
providing the necessary funding. It punishes schools identified as low- 
performing, rather than provide the resources they require to become more 
effective. It fails to recognize schools that are improving but fall a few points 
short of mandated goals. 

NCLB simply measures our schools by holding educators and school 
districts accountable for student achievement. 

West Virginia's public schools have always been accountable to the 
public, and our public schools are among the best in the nation. Parental 
involvement and community support, two key factors in a great public school, 
however, are absent from the NCLB assessment equation. Parents and 
communities must nurture their children, so that they come to school with a clear 
understanding and interest in the importance of learning. 

It is hard to argue with the premise of NCLB. On the other hand, it is not 
as simple as passing legislation and making it happen. One-size-fits-all 
legislation, such as NCLB, is not the solution to creating great public schools. 
Proclaiming that all students will perform at the proficient level by 2013-2014 
without fully funding the necessary resources to reach that goal is shortchanging 
the very students the law was supposed to protect. 232 
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Supplemental Search: Google 



A search was conducted on March 18, 2004, covering the previous 30 days. 
Several search terms were used to probe for the widest selection of stories. A selection of 
these stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A supplemental search was conducted seeking out stories specifically addressing 
consequences to schools, districts, teachers, and/or students. A variety of searches was 
conducted looking for specific consequential actions — both positive 233 and negative. 234 

Wyoming 

A search was conducted across the entire LexisNexis” universe of news media 
available in Wyoming. 236 This search returned 232 stories dating back to 1997. After 
redundant and irrelevant stories were eliminated, 74 were downloaded for closer review 
and possible selection for portfolio inclusion. 

Content Analysis 

The numbers of stories that were reviewed based on year and primary content are 
presented in Table 19. A description of the primary themes of these stories across time is 
described next. 
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Table 19: Story Tallies by Year and Category for Wyoming 



Year 


Number of 
Stories 


Category* 


Number of 
Stories per 
Category 


1997 


2 


L/R 


1/1 


1998 


7 


R/L/O 


4/1/2 


1999 


13 


R/L/O 


6/3/4 


2000 


22 


R/L/O 


10/5/7 


2001 


5 


R/L/O 


3/1/1 


2002 


9 


R/O 


6/3 


2003 


12 


R/L/O 


8/3/1 


2004 


4 


R/L 


3/1 



*NOTE: R=reporting-type stories (reports on student scores, policy, and research results); L= legislative 
oriented stories (refer to legislative voting and/or actual decisions as well as legal concerns that are brought 
to the courts); 0=opinion-oriented (include reactionary stories to news events as well as editorial columns); 
and PI=personal interest (these stories focus on specific individuals and their experiences in the high-stakes 
environment). 



A major theme introduced in 1998 and appearing throughout 1999 and 2000 was 
how the state would approach graduation requirements. Initially and when Wyoming 
Comprehensive Assessment System (WyCAS) was first administered, the policy was to 
hold students accountable — a part of the decision to award a student a diploma would be 
contingent on how he/she did on this test. However, the state never considered using the 
test as the sole criterion to award a student a diploma — it always included a compilation 
of information including report card grades, coursework, and teacher evaluations. 
However, in 2000, a proposal was raised to delay the new graduation requirements that 
linked WyCAS performance partly to graduation. The main issues were that the WyCAS 
still needed work, and to hinge a student’s diploma — even partially — on an imperfect 
measure would be wrong. One article in September of 2000 noted: 
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Mike Klopfenstein, assistant superintendent of instruction for Laramie County 
School District 1, said he thinks the district will be ready for the language arts and 
math requirements in 2003. 

"Whether that's fair to those kids is another question," he said. 
Klopfenstein said he hoped the board would wait to hold students accountable 
until 2005. "Unless we make sure we're not hurting kids in the process, we need 
to take a real hard look at it," he said. 

Klopfenstein said he would like to have a few years to test the system. 

"We don't want to put any kids at risk in the process," Klopfenstein said. 

Kirkbride said he believes that in the long run, the requirements will benefit the 
state and strengthen the value of a Wyoming high school diploma. 

Some of the main themes in 1999 were “reporting” and “opinion” in nature. 
Several reporting stories included documenting how students had scored on recent state 
examinations, whereas others focused on the continuous political debates such as one that 
appeared in November of 1999: 

The Wyoming School Boards Association will discuss two proposals dealing with 
the state's new standards and testing for students when it meets next week to 
consider its priorities for next year's state Legislature. 

One proposal would have local school boards, instead of the state, 
determine minimum academic standards for students to meet. The other seeks to 
have the state stop testing eleventh graders. 238 

Most of the opinion articles during 1999 centered on the controversy of merit pay 

for teachers. Specifically, a proposal for awarding teachers bonuses based on student 
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performance on WyCAS in Laramie, Wyoming was considered. Should teachers receive 
financial bonuses and incentives if their students’ test scores increase? A selection of 
opinion pieces, arguing both sides of the debate is included in the portfolio. One of the 
main arguments against the policy, expressed by both teachers and students, is that it 
would encourage teaching to the test — an approach that goes against sound educational 
practice. 

In 2000, one article described a state senator’s decision to publicly rank school 
districts based on the percentages of students who attained proficiency on the latest round 
of WyCAS testing. This action was met with criticism — some believing that publicly 
ranking districts is humiliating and goes against the intended purpose of testing students, 
which is to determine what is and is not working in schools. This story is included 
because it represents some of the views on public ranking and some of the dialogue 
around the purposes of the WyCAS test. 

In 2001 and beyond, most stories were “reporting” and documented several main 
themes. For example, several stories emerged around WyCAS — some were “political” 
(i.e., R/p) and simply reported on how districts, teachers, and students were readying for 
the upcoming assessment. In spite of the test not being “high stakes” for students, 
teachers commented on activities they did to calm students down or to provide incentives 
for them to show up and take the test seriously. 

Another major theme discussed miscellaneous issues related to the accountability 
policies. One writer lamented the “unfairness” of testing Native American students with 
WyCAS as it was culturally biased. Another talked about a proposal to create all day 
kindergarten as a way to start preparing students for testing early. 
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Another theme of stories centered on the range of political activities in the state as 
legislators wrangled with NCLB and how to incorporate it into their state philosophy. 

For example, in 2003, several stories emerged lamenting the mandates in NCLB. In 
October 2003, one writer complained that NCLB disadvantages students with disabilities 
and those for whom English is a second language: 

Not surprisingly, Triumph High Principal Gary Datus said he and his staff are 
focused on helping students succeed. "We want kids to stay in school and 
graduate," he said, defining the alternative school's goal. 

Students there have to meet the same requirement to graduate as those at 
the city's other two high schools. He said it is not a watered-down curriculum. 

But Datus said he is concerned about the effects the federal No Child Left Behind 
Act will have on his school. He's especially worried about the school meeting a 
performance target called adequate yearly progress. There are benefits and 
drawbacks to No Child Left Behind as it relates to these students, Riedel said. 

The good part is that schools really have to pay attention to these students 
[LEP], Riedel said. That's because they are counted as part of the requirements to 
meet adequate yearly progress. But the law's expectations are unrealistic, she 
said. Research shows it takes one or two years to master basic English survival 
skills and five to seven years to reach proficiency in speaking and writing, she 
added. There is a concern that the assessments will not test what they know in 
subjects, but how much English they know, Bridwell said. Some tests are written 
in Spanish, however. 239 

In December, a journalist reported on citizens’ reactions to NCLB: 
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CHEYENNE — Other states can envy Wyoming because of the number of its 



schools that meet achievement targets for a new federal law, education officials 
said Monday. 

While that was the good news about the No Child Left Behind Act, many 
in the audience at Monday's town hall meeting showed frustration and anxiety 
over the law. 

Some said it sets unfair expectations for certain students, most notably 
those in special education and students who speak little if any English. 240 

Supplemental Search: Google 

A search was conducted on March 18, 2004, covering the previous 30 days. 
Several search terms were used to probe for the widest selection of stories. A selection of 
these stories is included in the portfolio. 

Supplemental Search: LexisNexis 

A supplemental search was conducted seeking out stories specifically addressing 
consequences to schools, districts, teachers, and/or students. This search - was 
conducted for the previous year (February 2003 - February 2004) and produced 115 
stories, of which 16 were downloaded for further consideration and review. 
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Selected Documents: A BI/INFORM Selected Documents - Regional News; The Associated Press State & 
Local Wire; Business Dateline Database; Ethnic NewsWatch; Knight Ridder/Tribune Business 
News; Knight Ridder/Tribune Business News - Current News; Video Monitoring Services of 
America (formerly Radio TV Reports). 

63 Using the search string: (assess! or test!) and (high-stakes or accountab!) and (school or student or 

teacher) and not (sport or court ) 

64 Using the search string: (assess! or test!) and (high-stakes or accountab!) and (school or student or 

teacher) and not (sport or court) 

65 Although 94 were closely reviewed, additional stories were eliminated because of redundancy or 

irrelevancy (e.g., some of the Atlanta stories actually covered events in neighboring states) leaving 
66 stories from which a cross section were selected for portfolio inclusion. 

66 White, B. (1995, March 18). State testing program spared. The Atlanta Journa- Constitution, p. 4C. 

67 Editorial (1995, December 1 1). Student testing needs comprehensive reform. The Atlanta Journal- 

Constitution, p. 10A. 

68 Schrade, B. (1996, January 25). Schools graded B and C. The Augusta Chronicle, p. Al. 

69 Cumming, D. ( 1998, June 4). Exit exam cuts graduation rate. The Atlanta Journal- Constitution, p. 01c. 

70 Jones, S. L. (1999, October 10). New test raises stakes in Gwinnett. The Atlanta Journal-Constitution, p. 

1G. 

71 Using the search string: ((assess* or test*) and (teacher or student or principal or superintendent)) and 

((reward* or incentive or bonus) or (takeover or fire or punish or remove or close or retention or 
retain)) and not (candidate or court or health or charter) 

72 Using the search string: (assess! or test!) and (high-stakes or accountab!) and (school or student or 

teacher) and not (sport or court) 

73 Complete File: The Honolulu Advertiser. 

Selected Documents: The Associated Press State & Local Wire; Business Dateline - Regional News 
Sources. 

74 Associated Press (1999, March 24). Schools superintendent moves toward accountability. Honolulu, 

Author. 

75 Ibid. 

76 Reyes, B. J. (2004, February 15). Come November, choice for voters may be many. Honolulu., HI: 

Associated Press. 

77 Using the search string: ((assess* or test*) and (teacher or student or principal or superintendent)) and 

((reward* or incentive or bonus) or (takeover or fire or punish or remove or close or retention or 
retain)) 

78 Complete File: The Courier- Journal (Louisville, KY); Lexington Herald Leader. 

Selected Documents: The Associated Press State & Local Wire; Business Dateline - Regional News 

Sources; Knight Ridder/Tribune Business News; Knight Ridder/Tribune Business News - Current 
News; M. Lee Smith Publishers & Printers LLC - Regional News Stories 
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79 Using the search string: (ALLCAPS (CATS) or assess!) and (student or teacher) and ((accountab!) or 

(high stakes)) 

80 Wolfe, C. (1998, October 6). Standardized test will count for school accountability. Frankfort, KY: 

Associated Press. 

81 Wolfe, C. (1998, December 3). Cody: School accountability formula ‘flawed.’ Frankfort, KY: 

Associated Press. 

82 Wolfe, C. (1999, April 12). Board poised to adopt straight-line accountability model. Louisville, KY: 

Associated Press. 

82 Kentucky registers 28 public schools on federal ‘failing’ list. (2002, September 21). Lexington Herald- 
Leader. 

84 Using the search string: ((ALLCAPS (CAT)) or assess!) and (teacher or student or principal or 

superintendent)) and ((reward* or incentive or bonus) or (takeover or fire or punish or remove or 
close or retention or retain)) 

85 Complete File: The Advocate (Baton Rouge, LA); CityBusiness North Shore Report (New Orleans, LA); 

Daily Advertiser (Lafayette, LA); Daily Town Talk (Alexandria, LA); M. Lee Smith Publishers & 
Printers LLC - Regional News Stories; New Orleans CityBusiness (New Orleans, LA); The News 
Star (Monroe, LA); The Times-Picayune; The Times (Shreveport, LA). 

Selected Documents: The Associated Press State & Local Wire; Business Dateline - Regional News 
Sources; Video Monitoring Services of America (formerly Radio TV Reports). 

86 Using the search string: (ALLCAPS (LEAP or GEE)) and (student or teacher) and ((accountab!) or (high 

stakes)) 

87 (ALLCAPS (LEAP or GEE)) and (student or teacher) and ((accountab!) or (high stakes)) and not court or 

health or sport! 

88 Shipley, S. (1996, July 27). State plan to target 10 schools. Times-Picayune, p. A2. 

89 Waller, M. (1999, March 12). Schools prep for state tests: Some students say buildup makes anxiety even 

worse. Times-Picayune , p. B3. 

90 Myers, D. (1997, December 5). Accountability law is flawed, official says. The Advocate, p. 1A. 

91 Weiss, J. (1998, April 22). BESE debates consequences of failing new tests. Times-Picayune , p. A2. 

92 MacGlashan, S. ( 1999, February 26). Tests taking LEAP forward in difficulty. Times-Picayune, p. Bl. 

93 Minton, J. (1999, June 27). W. Feliciana students among top in LA on test. Capital City Press, p. Bl. 

94 Minton, J. (1999, June 27). W. Feliciana students among top in LA on test. Capital City Press, p. Bl. 

95 Gray, C. (1999, July 17). School's out for students preparing for LEAP test. Times-Picayune, p. B3. 

96 Gray, C. (2000, January 13). Pupils pay for schools’ failure, parents say. Times-Picayune, p. Bl. 

97 Gray, C. (2000, March 1). N.O. board's protest of LEAP rejected. Times-Picayune, p. A01. 

98 Gray, C. (2000, March 1). N.O. board's protest of LEAP rejected. Times-Picayune, p. A01. 

99 Thevenot, B. (2000, December 13). LEAP policy tweaked by panel. Times-Picayune, p. 5. 

100 Waller, M. (2001, November 7). Most Jefferson Parish schools get passing mark for academic growth. 

Times-Picayune, p. 1. 

101 Traina, M. (2000, September 3). LEAP is good for children. Times-Picayune, p. 06. 

102 Quirk, M. (2001, March 18). Mania for testing is doing harm to students. Times-Picayune, p. 8. 

103 School district accountability: Rankings and reactions (2003, April 1 1). Capital City Press. 
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104 Gill, J. (2003, May 30). Students need diplomas. Times-Picayune, p. 7, Editorial. 

105 DeBerry, J. (2003, June 6). No, LEAP testing is not a racist plot. Times-Picayune, p. 7, Editorial. 

106 A Compromise for LEAP testing (2003, August 21). The Advocate. 

107 Pope, J. (2003, May 7). State takeover of schools has group's OK. Times-Picayune, p. 1. 

108 Lussier, C. (2003, November 3). Educator takes on challenge. The Advocate. 

109 Deslatte, M. (2003, November 20). Less than a third of public schools meet targeted growth. Baton 

Rouge, LA: Associated Press. 

110 Using the search string: (ALLCAPS (LEAP or GEE) and (teacher or student or principal or 

superintendent)) and ((reward* or incentive or bonus) or (takeover or fire or punish or remove or 
close or retention or retain)) 

111 Using the search string: (assess! or test!) and (high-stakes or accountab! or reform) and not (sport or 

court or health) 

112 Complete File: The Clarion-Ledger (Jackson, MS); Hattiesburg American (Hattiesburg, MS); M. Lee 

Smith Publishers & Printers LLC - Regional News Stories The Sun Herald (Biloxi, MS). 

Selected Documents: The Associated Press State & Local Wire; Business Dateline - Regional News 

Sources; Knight Ridder/Tribune Business News; Knight Ridder/Tribune Business News - Current 
News 

113 Holland, G. (1999, February 4). School accountability bill approved. Jackson, MS: Associated Press. 

1 14 New tests set for 2-8 grades. ( 1999, October 29). Jackson MS: Associated Press. 

115 Brown, T. R. (2002, August 6). Mississippi sees decrease in low-performing schools. Jackson, MS: 

Associated Press. 

116 Sanctions for not meeting federal, state standards (2003, August 1). Associated Press. 

117 Bulkeley, D. (2003, August 30). Three Mississippi schools off state list of possible federal sanctions. 

Jackson, MS: Associated Press. 

118 Bulkeley, D. (2003, August 31). Teams ready to help priority school raise the bar. Jackson, MS: 

Associated Press. 

119 Using the search string: (ALLCAPS (MCT) or assess! or test!) and (teacher or student or principal or 

superintendent)) and ((reward* or incentive or bonus) or (takeover or fire or punish or remove or 
close or retention or retain)) 

120 Using the search string: (assess! or test!) and student(accountab! or high-stakes) and not (health or court 

or sport) 

121 Complete File: Kansas City Daily Record (Kansas City, MO); The Kansas City Star; M. Lee Smith 

Publishers & Printers LLC - Regional News Stories; Pitch Weekly (Kansas City KS & Kansas City 
MO); Riverfront Times (St. Louis, Missouri); Springfield News-Leader (Springfield MO); St. 
Charles County Business Record (St. Charles, MO); St. Louis Daily Record/St. Louis Countain 
(St. Louis MO); St. Louis Post-Dispatch. 

Selected Documents: ABI/INFORM Selected Documents - Regional News; The Associated Press State & 
Local Wire; Business Dateline - Regional News Sources; Knight Ridder/Tribune Business News; 
Knight Ridder/Tribune Business News - Current News; Video Monitoring Services of America 
(formerly Radio TV Reports) 

122 Little, J. (1994, June 13). New standards for graduates spark debate: Do they signify reform or a 

dumbing-down? St. Louis Post-Dispatch , p. IB. 

123 Thomson, S. C. ( 1996, October 30). Student testing far from standard. St. Louis Post-Dispatch , p. IB. 
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124 Bower, C. (1999, September 15). Missouri students improve slightly on standardized tests. St. Louis 

Post-Dispatch , p. Al. 

125 Ehlmann, S. E. (2000, September 13). How do you know if your school is doing well? St. Louis Post- 

Dispatch, p. B7, Editorial. 

126 Hochman, J. I. (2001, June 26). Educating widgets: Like other states, Missouri risks letting the federal 

government take away students’ individuality with annual testing. St. Louis Post-Dispatch, p. B7, 
Editorial commentary column. 

127 A look at Missouri’s new school accountability law (2002, June 19). Associated Press. 

128 Using the search string: (ALLCAPS (MAP) and (teacher or student or principal or superintendent)) and 

((reward* or incentive or bonus) or (takeover or fire or punish or remove or close or retention or 
retain)) 

129 Complete File: The Albuquerque Journal, The Albuquerque Tribune', M. Lee Smith Publishers & 

Printers LLC - Regional News Stories; The Santa Fe New Mexican. 

Selected Documents: The Associated Press State & Local Wire; Business Dateline - Regional News 

Sources; Knight Ridder/Tribune Business News; Knight Ridder/Tribune Business News - Current 
News. 

130 Using the search string: (assess!) and (student or teacher) and ((accountab!) or (high stakes)) and not 

sport 

131 Gallegos, G. (1997, September 3). Tests will see if N. M. kids meet state standards. Albuquerque 

Tribune, p. All. 

132 Gallegos, G. (1999, December 18). Ready... set... test. Albuquerque Tribune, p. Al. 

133 Schoellkopf, A. (2000, August 11). Test of students called flawed. Albuquerque Tribune, p. 1. 

134 Holmes, S. M. (2000, August 26). School accountability ratings released. Associated Press. 

135 Schoellkopf, A. (2001, January 23). Rio Rancho district ranks high in state accountability report. 

Albuquerque Journal, p. 1 . 

136 Using the search string: ((assess!) and (teacher or student or principal or superintendent)) and ((reward* 

or incentive or bonus) or (takeover or fire or punish or remove or close or retention or retain))and 
not (sport or health or court or college or university) 

137 Complete File: The Buffalo News, Columbia Journalism Review, Crain 's New York Business, Daily 

News (New York), The Daily Record of Rochester (Rochester, NY), The Ithaca Journal (Ithaca, 
NY), The Journal News (Westchester County, NY), Long Island Business News (Long Island. 
NY), M. Lee Smith Publishers & Printers LLC - Regional News Stories, Newsday (New York, 
NY), The News-Press (Fort Myers, FL), New York Employment Law & Practice, The New Yorker, 
New York Family Law Monthly, New York Law Journal, New York Observer, The New York Post, 
New York Sun, The New York Times, Observer-Dispatch (Utica, NY), The Post-Standard 
(Syracuse, NY), Poughkeepsie Journal (Poughkeepsie, NY), Press & Sun-Bulletin (Binghamton, 
NY), Rochester Democrat and Chronicle, Star-Gazette (Elmira, NY), St. Charles Comity Business 
Record (St. Charles, MO), The Times Union (Albany, NY), The Village Voice. 

Selected Documents: ABI/INFORM Selected Documents - Regional News, The Associated Press State & 
Local Wire, Business Dateline - Regional News Sources, Ethnic NewsWatch, Knight 
Ridder/Tribune Business News, Knight Ridder/Tribune Business News - Current News, Video 
Monitoring Services of America (formerly Radio TV Reports) 

138 Using the search string: (assess* or test*) and ((high stakes) or accountab*) and (school or teacher or 

student) 

139 Using the search string: (assess* or test*) and ((high stakes) or accountab*) and (school or teacher or 

student) 
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140 Using the search string: (assess* or test*) and ((high stakes) or accountab*) and (school or teacher or 

student) 

141 No correlation between Regents exams and success. (1996, February 27). Buffalo News, p. 2C, Editorial 

Page. 

142 No correlation between Regents exams and success. ( 1996, February 27). Buffalo News, p. 2C, Editorial 

Page. 

143 Kershaw, S. (1996, March 4). Management lessons for Roosevelt schools. New York Times, p. B5. 

144 New York schools face new tests beginning in January. (1998, December 29). Syracuse, NY: 

Associated Press. 

145 Gendar, A., & Shin, P. H. B. (1999, June 2). Grades 4, 8 feel pressure of new exams: School takeover at 

stake. Daily News, p. 23. 

146 Goodnough, A. (2000, October 13). Most eighth graders fail state math test. New York Times, p. B3. 

147 Ross, E. W. (2000, October 22). Tests are biased against minorities and the poor. Times Union, p. B4, 

Perspective. 

148 Gormley, M. (2001, May 6). Standard testing creates pressure. Times Union, p. A4. 

149 Using the search string: ((assess* or test*) and (teacher or student or principal or superintendent)) and 

((reward* or incentive or bonus) or (takeover or fire or punish or remove or close or retention or 
retain)) 

150 Using the search string: (Regents exam*) and (teacher or student or principal or superintendent)) and 

(reward* or incentive or bonus or scholarship) and not sport 

151 Using the search string: (Regents exam*) and (takeover or fail or (school close) or (student retention) 

152 Using the search string: (ALLCAPS (SALT) or test!) and (high-stakes or accountab!) and (school or 

student or teacher) and not (sport or court) 

153 Complete Lile: M. Lee Smith Publishers & Printers LLC - Regional News Stories, The Providence 

Journal-Bulletin. 

Selected Documents: The Associated Press State & Local Wire, Business Dateline - Regional News 

Sources, Knight Ridder/Tribune Business News, Knight Ridder/Tribune Business News - Current 
News, Video Monitoring Services of America (formerly Radio TV Reports). 

154 McVicar, D. M. (1997, July 27). R. I. schools to be graded on how well they perform. Providence 

Journal-Bulletin, p. 1A. 

155 Morgan, T. J. (1998, January 6). Opinion survey coming to school. Providence Journal-Bulletin, p. 1C. 

156 Poon, C. (1998, May 26). School board head impugns new state education standards: Glenn Brewer 

favors a curriculum that teaches a set of facts in the subject areas, rather than one emphasizing 
“critical thinking” skills. Providence Journal-Bulletin, p. 1C. 

157 Rasmussen, K. (2001, November 28). SALT team finds a lot that’s good at Byfield school. Providence 

Journal-Bulletin, p. C01. 

158 Emlock, E. (2001, December 7). Survey: Middle school students, teachers “connect.” Providence 

Journal-Bulletin, p. C01. 

159 Steinke, D. (2002, May 31). SALT report finds friction at Steere Larm. Providence Journal-Bulletin, p. 

C01. 

160 Polichetti, B. (2003, February 18). Rating team gives Park View Middle School dismal review. 

Providence Journal-Bulletin, p. C01. 
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161 Using the search string: (ALLCAPS (SALT) and (teacher or student or principal or superintendent)) 

and ((reward* or incentive or bonus) or (takeover or fire or punish or remove or close or retention 
or retain)) 

162 Using the search string: (ALLCAPS (PACT) or (HASP) or assess! or test!) and (high-stakes or 

accountab!) and (school or student or teacher) and not (sport or court) 

163 Complete File: The Greenville News (Greenville, SC); The Herald (Rock Hill, S.C.); M. Lee Smith 

Publishers & Printers LLC - Regional News Stories; The Post and Courier (Charleston, SC); The 
State (Columbia, S.C.). 

Selected Documents: The Associated Press State & Local Wire; Business Dateline - Regional News 

Sources; Knight Ridder/Tribune Business News; Knight Ridder/Tribune Business News - Current 
News. 

164 By eliminating the words “test” and “assessment” it made the pool of stories from which to review more 

manageable. The search string used was: (ALLCAPS (PACT) or (HASP)) and (high-stakes or 
accountab!) and (school or student or teacher) and not (sport or court) 

165 Using the search string: (ALLCAPS (PACT) or test! or assess!) and (high stakes) or (accountab!) and 

not (court or health) 

166 Using the search string: (ALLCAPS (PACT) or (HASP) or assess! or test!) and (high-stakes or 

accountab!) and (school or student or teacher) and not (sport or court) 

167 Guerard, M. B. (1997, October 17). State board rethinks school incentive fund. The Post and Courier, 

p. Al. 

168 Torres, K. (1997, December 1 1). State Board of Education endorses stronger standards. The Post and 

Courier, p. B6. 

69 Robinson, B. (1998, April 21). Disagreement on wording could make obsolete South Carolina-wide 
student exams. The State. 

170 Holland, J. ( 1999, October 21). Students face PACT accountability, many don't pass first test. 

Columbia, SC: Associated Press. 

171 High failure rates on PACT scores may test lawmaker resolve, state budget. (2000, November 15). 

Greenville, SC: Associated Press. 

I7 ~ Bruce, A. (2000, November 1). Area districts see increase in test scores. The Herald, p. 1A. 

173 Holland, J. (2001, April 27). Students, teachers anxious for PACT time. Columbia, SC: Associated 

Press. 

174 Using the search string: (ALLCAPS (PACT) or (HASP) and (teacher or student or principal or 

superintendent)) and ((reward* or incentive or bonus) or (takeover or fire or punish or remove or 
close or retention or retain)) 

175 Using the search string: ALLCAPS (LIFE) and student and scholarship 

176 Using the search string: (assess! or test!) and (high-stakes or accountab!) and (school or student or 

teacher) and not (sport or court) 

177 Complete File: Chattanooga Times Free Press', The Commercial Appeal (Memphis); Knoxville News- 

Sentinel (Knoxville, TN); The Leaf-Chronicle (Clarksville, TN); M. Lee Smith Publishers & 
Printers LLC - Regional News Stories; The Tennessean (Nashville); Tennessee Employment Law 
Letter. 

Selected Documents: The Associated Press State & Local Wire; Business Dateline - Regional News 

Sources; Knight Ridder/Tribune Business News; Knight Ridder/Tribune Business News - Current 
News. 
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178 Using the search string: (ALLCAPS (TCAP)) and (high-stakes or accountab!) and (school or student or 

teacher) and not (sport or court) 

179 Using the search string: (assess! or test!) and (high-stakes or accountab!) and (school or student or 

teacher) and not (sport or court) 

180 State re-evaluating its method of testing students, schools. ( 1995, December 1 1). Chattanooga Free 

Press, Author. 

181 A time for testing: Weakening state program would also erode schools’ accountability (1996, December 

4). Knoxville News-Sentinel, Comment, p. A14. 

IS ~ Wiatrowski, K. (1998, November 10). Grading our schools: 4 schools make straight A’s on state’s 
assessment report. The Chattanooga Times, p. Al. 

183 Sutton, L. (1999, August 13). Test scores for county called OK: System results lag behind state in all 

areas, grades. Chattanooga Free Press, p. Al. 

184 Edmondson, A., & Anderson, M. (2000, July 21). City schools expect poor report card: State to issue 

warning list on 48 worst performers. The Commercial Appeal, p. Al. 

185 Locker, R. (2000, July 22). More than half of Tennessee’s troubled schools in Memphis: State requires 

26 “failures” to improve substantially. The Commercial Appeal, p. Al. 

186 Sharp, T. (2000, November 16). State releases first school-by-school “report card.” Nashville, TN: 

Associated Press. 

187 Sutton, L. (2001, March 11). Hamilton schools in top 20 ranking. Chattanooga Times Free Press, p. 

Al. 

188 Erskine, M. (2001, September 22). 6 schools rejoice at “movin' on up” from state risk list. The 

Commercial Appeal, p. Al. 

189 Banerji, R. (2003, September 23). TCAP Challenges spirit: Dire stakes directing her class now, a 

veteran sighs. The Commercial Appeal, p. Al. 

190 Using the search string: (ALLCAPS (TCAP) and (teacher or student or principal or superintendent)) and 

((reward* or incentive or bonus) or (takeover or fire or punish or remove or close or retention or 
retain)) and not court or health 

191 Because the assessment system in Texas changed over time, two searches were conducted looking for 

stories that contained the acronyms relevant to these two systems. The first search string used was: 
[(ALLCAPS (TAAS)) and (high stake) and accountab!]. The second search string replaced TAAS 
with TAKS, the new acronym: [(ALLCAPS (TAKS)) and (high stake) and accountab!]. 

192 The complete file on LexisNexis includes: The Austin American-Statesman, Austin Business Journal, 

Corpus Christi Caller-Times, The Dallas Morning News, Dallas Observer (Texas), El Paso Times 
(El Paso, TX), Fort Worth Star-Telegram, The Houston Chronicle, Houston Press (Texas), M. Lee 
Smith Publishers & Printers LLC - Regional News Stories, San Antonio Express-News, The Texas 
Lawyer, . 

193 Grading the TAAS: Express-News readers share their opinions after taking the test Texas requires for 

high school graduation. (1999, November 9). San Antonio Express-News, p. 4B. 

194 Grading the TAAS: Express-News readers share their opinions after taking the test Texas requires for 

high school graduation. (1999, November 9). San Antonio Express-News, p. 4B. 

195 Hood, L. (2001, May 30). TAAS' impact under examination: Critics say test fuels dropout rate, but 

others say proof isn’t there. San Antonio Express-News, p. 1 1 A. 

196 Using the search string: ((state takeover) and (school) and (test!)) or ((teacher or principal) and 

(resignat!)). This search yielded 144 hits, but none useful. 
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197 Two were related to budget deficits, one covered reasons why the education commissioner was leaving 

at the end of his term, another had to do with a superintendent who decided to resign, another was 
about a teacher who resigned after a troubled student committed suicide, another story was of a 
teacher who was suing to know the identity of a student who accused her of “helping students to 
cheat” on the standardized exam, and one reports on the extension of a superintendent's contract 
and two focus on budgetary issues in the state. 

198 Using the search string: (teacher or principal or superintendent) and (assessment) and (bonus or 

incentive)) 

199 Using the search string: (ALLCAPS (U-PASS) or test!) and (high-stakes or accountab!) and not (sport 

or court or health or college) 

200 Complete File: Deseret Morning News (Salt Lake City); M. Lee Smith Publishers & Printers LLC - 

Regional News Stories; The Salt Lake Tribune. 

Selected Documents: The Associated Press State & Local Wire; Business Dateline - Regional News 

Sources; Knight Ridder/Tribune Business News; Knight Ridder/Tribune Business News - Current 
News 

201 Kapos, K. (1994, December 8). 5 ,h -grade scores mar Utah’s reading tests reading: Utah scores mostly 

positive. Sal Lake Tribune, p. Al. 

Haney, J. P., & Toomer-Cook, J. (1999, January 25). School accountability urged. Deseret News, p. 
B01. 

203 School bills aimed at accountability (1999, March 4). Deseret News, p. A16. 

204 Teachers and accountability (1999, February 14). Teachers and accountability. Deseret News, Opinion, 

p. AA1. 

205 Toomer-Cook, J. (1999, October 21). Educators flay standardized tests. Deseret News, p. B01. 

206 Schools should demand success (2000, July 6). Deseret News, Opinion, p. A14. 

207 Grading schools: Why not? (2000, September 4). Deseret News, Opinion, p. A12. 

208 Toomer-Cook, J. (2000, March 2). Measure on school testing is approved. Deseret News, p. A13. 

209 Toomer-Cook, J. (2003, February 3). High school test takers in hot seat. Deseret News, p. B05. 

210 Hayes, E. (2003, June 18). State’s skills test may get ax. Deseret Morning News, p. A01. 

211 Lynn, R. (2004, February 1). Skills exam is no longer just a test: This year’s sophomore students 

required to pass test. Salt Lake Tribune, p. Bl. 

212 Using two types of search strings: 

• (ALLCAPS (U-PASS) and (student or teacher) and (reward* or incentive or bonus or scholarship) 
and not (sport or court or health or college) 

• (test!) and school and (reward or bonus or award) and not (sport or court or health or college) 

~ 13 Using the search string: (ALLCAPS (U-PASS) and (student or teacher or school) and (takeover or 
reform) and not (sport or court or health or college). 

~ 14 Using the search string: (assess! or test!) and (high-stakes or accountab!) and (school or student or 
teacher) and not (sport or court) 

215 Complete File: The Daily News Leader (Staunton, VA), Daily Press (Newport News), Dolan ’s Virginia 
Business Observer (Norfolk, VA), M. Lee Smith Publishers & Printers LLC - Regional News 
Stories, Richmond Times Dispatch, Roanoke Times & World News, The Virginian-Pilot (Norfolk, 
VA). 
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Selected Documents: The Associated Press State & Local Wire, Business Dateline - Regional News 

Sources, Knight Ridder/Tribune Business News, Knight Ridder/Tribune Business News - Current 
News, Video Monitoring Services of America (formerly Radio TV Reports) 

~ 16 The search string was slightly modified to reduce the overall number of stories: (assess!) and (high- 
stakes or accountab!) and (school or student or teacher) and not (sport or court) 

~ 17 Using the modified search string: (assess!) and (high-stakes or accountab!) and (school or student or 
teacher) and not (sport or court ) 

~ 18 Glass, J. (1995, March 23). Schools must aim higher, official says. The Virginia-Pilot, p. All. 

219 Glass, J. (1995, March 27). New standards for schools: Are these changes the right ones? The Virginia- 
Pilot, p. Al. 

~ 20 Bull, D. L. (1996, February 11). Teaching is being hindered. Roanoke Times & World News , Editorial, 
p. F2. 

221 Yes to testing (1996, January 26). Richmond Times Dispatch, Editorial, p. A14. 

222 Standards of learning: Stay the course. (1999, June 2). The Virginian-Pilot, p. BIO. 

223 Bowers, M. (1999, April 3). Educators say tying bonuses to student tests is unfair: Other factors can 

affect achievement, teachers say. The Virginian-Pilot, p. Bl. 

224 Using the search string: (ALLCAPS (SOL) and (teacher or student or principal or superintendent)) and 

((reward* or incentive or bonus) or (takeover or fire or punish or remove or close or retention or 
retain)) 

225 Complete File: Charleston Daily Mail', The Charleston Gazette', Herald-Dispatch (Huntington, WV); 

M. Lee Smith Publishers & Printers LLC - Regional News Stories. 

Selected Documents: The Associated Press State & Local Wire; Business Dateline - Regional News 

Sources; Knight Ridder/Tribune Business News; Knight Ridder/Tribune Business News - Current 
News. 

226 Using the search string: (ALLCAPS (WESTEST) or assess! or test!) and (accountab! or (high stakes)) 

and not (court or sport or health) 

~ 27 African Americanford, L. B. ( 1995, July 30). The testing dilemma: Should students be coached for a 
standardized test? Charleston Gazette, p. IB. 

228 Your views: Testing schools must be held accountability with as little disruption as possible. (2001, 

January 31). Charleston Daily Mail, Editorial, p. 4A. 

229 Bundy, J. (2002, December 8). Test-time pressure likely to increase state adjusting its tests to ensure it 

meets federal No Child Left Behind guides. Charleston Gazette, p. 2B. 

230 Smith, C. (2003, April 4). School officials see stakes in testing: Reform means schools may face 

tougher sanctions. Charleston Daily Mail, p. 8A. 

231 Byrne, B. (2003, October 5). Why I like this law. Charleston Gazette, Editorial, p. 1C. 

232 Lange, T. (2003, November 24). No Child Left Behind Act: Cookie -cutter regulations treat 

schoolchildren unfairly. Charleston Gazette, Editorial, p. 5A. 

233 Such as those using the search string: (ALLCAPS (WESTEST) or test!) and teacher and (reward! or 

incentive or bonus) and (ALLCAPS (WESTEST) or test!) and student and (scholarship or 
tuition) 

234 Using the search string: (ALLCAPS (WESTEST) or test!) and school and reform and (takeover or 

closure or fail) 
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235 Complete File: M. Lee Smith Publishers & Printers LLC - Regional News Stories; The Wyoming 
Tribune-Eagle. 

Selected Documents: The Associated Press State & Local Wire; Ethnic NewsWatch 

~ 36 Using the search string: (ALLCAPS (WYCAS) or assess! or test!) and (accountab! or (high stakes)) and 
not (court or sport or health) 

237 Milner, K. (2000, September 21). Wyoming education association seeks delay on graduation 
requirements. Wyoming Tribune-Eagle , p. Al. 

~ 38 School boards looking at changing who sets state standards (1999, November 11). Cheyenne, WY: 
Associated Press. 

239 Oit, B. (2003, October 12). “No Child” could leave alternative students behind. Cheyenne, WY: 

Associated Press. 

240 Orr, B. (2003, December 2). “No Child" raises anxiety, frustration. Wyoming Tribune-Eagle, p. Al. 

241 Using the search string: (ALLCAPS (WYCAS) or assess! or test!) and (teacher or student or principal 

or superintendent)) and ((reward* or incentive or bonus) or (takeover or fire or punish or remove 
or close or retention or retain)) 
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